[ 529.510845] env[65216]: /opt/stack/neutron/neutron/__init__.py:25: UserWarning: The selected oslo_service backend is "eventlet" [ 529.510845] env[65216]: warnings.warn('The selected oslo_service backend is "eventlet"') [ 530.509874] env[65306]: /opt/stack/neutron/neutron/__init__.py:25: UserWarning: The selected oslo_service backend is "eventlet" [ 530.509874] env[65306]: warnings.warn('The selected oslo_service backend is "eventlet"') [ 532.065033] env[65306]: INFO neutron.common.config [-] Logging enabled! [ 532.065033] env[65306]: INFO neutron.common.config [-] /opt/stack/data/venv/bin/neutron-nsxv3-agent version 27.0.1.dev60 [ 532.065033] env[65306]: DEBUG neutron.common.config [-] command line: /opt/stack/data/venv/bin/neutron-nsxv3-agent --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini --config-file /etc/neutron/plugins/ml2/ml2-nsxv3-1.ini {{(pid=65306) setup_logging /opt/stack/neutron/neutron/common/config.py:124}} [ 532.065033] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] VMware NSXv3 Agent initializing ... [ 532.065033] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] Eventlet blocking behavior detection initialization completed. [ 532.065515] env[65306]: WARNING oslo_policy.policy [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. [ 532.065515] env[65306]: WARNING oslo_policy.policy [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. [ 532.067012] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] VMware NSXv3 Agent initialized successfully. [ 532.067397] env[65306]: DEBUG oslo_concurrency.lockutils [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] Acquiring lock "singleton_lock" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 532.067532] env[65306]: DEBUG oslo_concurrency.lockutils [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] Acquired lock "singleton_lock" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 532.067723] env[65306]: DEBUG oslo_concurrency.lockutils [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] Releasing lock "singleton_lock" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 532.068018] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] Full set of CONF: {{(pid=65306) _wait_for_exit_or_signal /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:274}} [ 532.068131] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] ******************************************************************************** {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2804}} [ 532.068234] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] Configuration options gathered from: {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2805}} [ 532.068615] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] command line args: ['--config-file', '/etc/neutron/neutron.conf', '--config-file', '/etc/neutron/plugins/ml2/ml2_conf.ini', '--config-file', '/etc/neutron/plugins/ml2/ml2-nsxv3-1.ini'] {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2806}} [ 532.068787] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] config files: ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini', '/etc/neutron/plugins/ml2/ml2-nsxv3-1.ini'] {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2807}} [ 532.068894] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] ================================================================================ {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2809}} [ 532.069072] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] agent_down_time = 75 {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.069213] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] allow_automatic_dhcp_failover = True {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.069350] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] allow_bulk = True {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.069491] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] api_extensions_path = {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.069654] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] api_paste_config = api-paste.ini {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.069798] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] auth_strategy = keystone {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.069903] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] backdoor_port = None {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.070011] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] backdoor_socket = None {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.070151] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] backlog = 4096 {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.070287] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] base_mac = fa:16:3e:00:00:00 {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.070443] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] bind_host = 0.0.0.0 {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.070581] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] bind_port = 9696 {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.070769] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] client_socket_timeout = 900 {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.070992] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] config_dir = [] {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.071164] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] config_file = ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini', '/etc/neutron/plugins/ml2/ml2-nsxv3-1.ini'] {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.071319] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] config_source = [] {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.071462] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] control_exchange = neutron {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.071654] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] core_plugin = ml2 {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.071809] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] debug = True {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.071948] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] default_availability_zones = [] {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.072170] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'OFPHandler=INFO', 'OfctlService=INFO', 'os_ken.base.app_manager=INFO', 'os_ken.controller.controller=INFO'] {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.072312] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] dhcp_agent_notification = True {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.072447] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] dhcp_agents_per_network = 1 {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.072575] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] dhcp_lease_duration = 86400 {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.072713] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] dhcp_load_type = networks {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.072849] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] dns_domain = openstacklocal {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.072984] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] dvr_base_mac = fa:16:3f:00:00:00 {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.073126] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] enable_default_route_bfd = False {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.073255] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] enable_default_route_ecmp = False {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.073384] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] enable_dvr = True {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.073511] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] enable_new_agents = True {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.073640] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] enable_services_on_agents_with_admin_state_down = False {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.073804] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] enable_signals = True {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.073897] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] enable_traditional_dhcp = True {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.074029] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] external_dns_driver = None {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.074162] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] filter_validation = True {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.074302] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] global_physnet_mtu = 8950 {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.074435] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] graceful_shutdown_timeout = 60 {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.074647] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] host = cpu-1 {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.074794] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] host_dvr_for_dhcp = True {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.074925] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] http_retries = 3 {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.075080] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] instance_format = [instance: %(uuid)s] {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.075250] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.075412] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] ipam_driver = internal {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.075546] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] ipv6_pd_enabled = False {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.075676] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] l3_ha = False {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.075812] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] l3_ha_net_cidr = 169.254.192.0/18 {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.075946] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] l3_ha_network_physical_name = {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.076093] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] l3_ha_network_type = {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.076232] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] log_color = False {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.076374] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] log_config_append = None {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.076512] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.076636] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] log_dir = None {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.076765] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] log_file = None {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.076867] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] log_options = True {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.077009] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] log_rotate_interval = 1 {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.077150] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] log_rotate_interval_type = days {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.077311] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] log_rotation_type = none {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.077431] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.077522] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.077665] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.077801] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.077903] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.078046] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] max_dns_nameservers = 5 {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.078178] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] max_header_line = 16384 {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.078306] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] max_l3_agents_per_router = 3 {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.078438] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] max_logfile_count = 30 {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.078564] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] max_logfile_size_mb = 200 {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.078697] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] max_subnet_host_routes = 20 {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.078828] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] my_ip = 10.180.1.21 {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.078961] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] my_ipv6 = ::1 {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.079108] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] network_auto_schedule = True {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.079241] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] network_link_prefix = None {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.079373] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] network_scheduler_driver = neutron.scheduler.dhcp_agent_scheduler.WeightScheduler {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.079511] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] notify_nova_on_port_data_changes = True {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.079669] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] notify_nova_on_port_status_changes = True {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.079807] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] pagination_max_limit = -1 {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.079962] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] publish_errors = False {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.080077] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] rate_limit_burst = 0 {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.080216] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] rate_limit_except_level = CRITICAL {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.080346] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] rate_limit_interval = 0 {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.080471] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] retry_until_window = 30 {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.080597] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] router_distributed = False {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.080724] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] rpc_resources_processing_step = 20 {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.080852] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] rpc_response_max_timeout = 600 {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.080978] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] rpc_response_timeout = 60 {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.081116] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] send_events_interval = 2 {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.081262] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] service_plugins = ['router'] {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.081400] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] setproctitle = on {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.081526] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] shell_completion = None {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.081659] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] state_path = /opt/stack/data/neutron {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.081791] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] syslog_log_facility = LOG_USER {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.081921] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] tcp_keepidle = 600 {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.082063] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] transport_url = **** {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.082195] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] use_journal = False {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.082322] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] use_json = False {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.082450] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] use_ssl = False {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.082572] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] use_stderr = False {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.082705] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] use_syslog = False {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.082829] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] vlan_qinq = None {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.082953] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] vlan_transparent = None {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.083090] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] watch_log_file = False {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.083218] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] wsgi_default_pool_size = 100 {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.083345] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] wsgi_keep_alive = True {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.083479] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.083604] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] wsgi_server_debug = False {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.083751] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] oslo_concurrency.disable_process_locking = False {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.083890] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] oslo_concurrency.lock_path = /opt/stack/data/neutron/lock {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.084042] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.084168] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.084305] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] oslo_messaging_metrics.metrics_process_name = {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.084443] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.084572] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.084718] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] profiler.connection_string = messaging:// {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.084856] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] profiler.enabled = False {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.084995] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] profiler.es_doc_type = notification {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.085165] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] profiler.es_scroll_size = 10000 {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.085316] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] profiler.es_scroll_time = 2m {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.085455] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] profiler.filter_error_trace = False {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.085590] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] profiler.hmac_keys = **** {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.085727] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] profiler.sentinel_service_name = mymaster {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.085868] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] profiler.socket_timeout = 0.1 {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.086184] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] profiler.trace_requests = False {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.086184] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] profiler.trace_sqlalchemy = False {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.086282] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] profiler_jaeger.process_tags = {} {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.086394] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] profiler_jaeger.service_name_prefix = None {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.086527] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] profiler_otlp.service_name_prefix = None {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.086671] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] oslo_policy.enforce_new_defaults = True {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.086935] env[65306]: WARNING oslo_config.cfg [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. [ 532.087097] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] oslo_policy.enforce_scope = True {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.087261] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] oslo_policy.policy_default_rule = default {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.087421] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.087565] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] oslo_policy.policy_file = /etc/neutron/policy.json {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.087704] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.087836] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.087966] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.088104] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.088241] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.088375] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] oslo_policy.remote_timeout = 60.0 {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.088520] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.088663] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] agent.extensions = [] {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.088800] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.088939] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] service_providers.service_provider = [] {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.089089] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] QUOTAS.default_quota = -1 {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.089231] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] QUOTAS.quota_driver = neutron.db.quota.driver_nolock.DbQuotaNoLockDriver {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.089365] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] QUOTAS.quota_floatingip = 50 {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.089495] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] QUOTAS.quota_network = 100 {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.089634] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] QUOTAS.quota_port = 500 {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.089762] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] QUOTAS.quota_rbac_policy = 10 {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.089889] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] QUOTAS.quota_router = 10 {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.090036] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] QUOTAS.quota_security_group = 10 {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.090169] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] QUOTAS.quota_security_group_rule = 100 {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.090301] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] QUOTAS.quota_subnet = 100 {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.090429] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] QUOTAS.track_quota_usage = True {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.090571] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] privsep.capabilities = [21, 12, 1, 2, 19] {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.090701] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] privsep.group = None {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.090827] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] privsep.helper_command = None {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.090957] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] privsep.log_daemon_traceback = False {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.091105] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] privsep.logger_name = oslo_privsep.daemon {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.091237] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] privsep.thread_pool_size = 8 {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.091367] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] privsep.user = None {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.091506] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] privsep_dhcp_release.capabilities = [21, 12] {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.091632] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] privsep_dhcp_release.group = None {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.091758] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] privsep_dhcp_release.helper_command = None {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.091888] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] privsep_dhcp_release.log_daemon_traceback = False {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.092026] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] privsep_dhcp_release.logger_name = oslo_privsep.daemon {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.092161] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] privsep_dhcp_release.thread_pool_size = 8 {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.092287] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] privsep_dhcp_release.user = None {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.092426] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] privsep_ovs_vsctl.capabilities = [21, 12] {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.092551] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] privsep_ovs_vsctl.group = None {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.092677] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] privsep_ovs_vsctl.helper_command = None {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.092806] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] privsep_ovs_vsctl.log_daemon_traceback = False {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.092939] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] privsep_ovs_vsctl.logger_name = oslo_privsep.daemon {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.093081] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] privsep_ovs_vsctl.thread_pool_size = 8 {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.093211] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] privsep_ovs_vsctl.user = None {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.093349] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] privsep_namespace.capabilities = [21] {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.093473] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] privsep_namespace.group = None {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.093600] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] privsep_namespace.helper_command = None {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.093730] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] privsep_namespace.log_daemon_traceback = False {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.093864] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] privsep_namespace.logger_name = oslo_privsep.daemon {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.093996] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] privsep_namespace.thread_pool_size = 8 {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.094135] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] privsep_namespace.user = None {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.094272] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] privsep_conntrack.capabilities = [12] {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.094398] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] privsep_conntrack.group = None {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.094523] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] privsep_conntrack.helper_command = None {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.094653] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] privsep_conntrack.log_daemon_traceback = False {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.094787] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] privsep_conntrack.logger_name = oslo_privsep.daemon {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.094921] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] privsep_conntrack.thread_pool_size = 8 {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.095056] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] privsep_conntrack.user = None {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.095289] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] privsep_link.capabilities = [12, 21] {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.095435] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] privsep_link.group = None {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.095568] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] privsep_link.helper_command = None {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.095703] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] privsep_link.log_daemon_traceback = False {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.095839] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] privsep_link.logger_name = oslo_privsep.daemon {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.095972] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] privsep_link.thread_pool_size = 8 {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.096115] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] privsep_link.user = None {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.096269] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] AGENT.agent_id = nsxm-l-01a.corp.local {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.096420] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] AGENT.agent_prometheus_exporter_port = 8000 {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.096556] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] AGENT.continue_on_failed_promotions = False {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.096687] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] AGENT.dscp = None {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.096824] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] AGENT.dscp_inherit = False {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.096967] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] AGENT.force_mp_to_policy = True {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.097113] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] AGENT.locking_coordinator_url = None {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.097280] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] AGENT.log_agent_heartbeats = False {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.097425] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] AGENT.logging_expire = 1 {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.097569] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] AGENT.logging_url = unix:///var/run/redis/socket/redis.sock {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.097707] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] AGENT.max_sg_tags_per_segment_port = 27 {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.097849] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] AGENT.polling_interval = 240 {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.097986] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] AGENT.ports_tag_number_decrease_workaround = True {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.098140] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] AGENT.quitting_rpc_timeout = 120 {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.098303] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] AGENT.report_interval = 30.0 {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.098454] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] AGENT.root_helper = sudo /opt/stack/data/venv/bin/neutron-rootwrap /etc/neutron/rootwrap.conf {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.098594] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] AGENT.root_helper_daemon = sudo /opt/stack/data/venv/bin/neutron-rootwrap-daemon /etc/neutron/rootwrap.conf {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.098734] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] AGENT.rpc_max_records_per_query = 1000 {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.098872] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] AGENT.sync_skew = 60 {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.099035] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] AGENT.synchronization_queue_size = 20 {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.099161] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] AGENT.use_helper_for_ns_read = True {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.099306] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] SECURITYGROUP.enable_ipset = True {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.099452] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] SECURITYGROUP.enable_security_group = True {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.099591] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] SECURITYGROUP.firewall_driver = nsxv3 {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.099729] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] SECURITYGROUP.permitted_ethertypes = [] {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.099868] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] experimental.ipv6_pd_enabled = False {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.100033] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] ml2.extension_drivers = ['port_security'] {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.100171] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] ml2.external_network_type = None {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.100318] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] ml2.mechanism_drivers = ['nsxv3', 'openvswitch', 'logger'] {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.100461] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] ml2.overlay_ip_version = 4 {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.100598] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] ml2.path_mtu = 8950 {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.100734] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] ml2.physical_network_mtus = {} {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.100877] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] ml2.tenant_network_types = ['vlan'] {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.101018] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] ml2.tunnelled_network_rp_name = rp_tunnelled {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.101164] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] ml2.type_drivers = ['vlan'] {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.101306] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] AGENT_CLI.neutron_port_id = [] {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.101441] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] AGENT_CLI.neutron_qos_policy_id = [] {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.101573] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] AGENT_CLI.neutron_security_group_id = [] {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.101715] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] NSXV3.nsxv3_concurrent_requests = 40 {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.101856] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] NSXV3.nsxv3_connection_retry_count = 2 {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.101992] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] NSXV3.nsxv3_connection_retry_sleep = 2 {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.102142] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] NSXV3.nsxv3_default_policy_infrastructure_rules = True {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.102283] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] NSXV3.nsxv3_dfw_connectivity_strategy = NONE {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.102422] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] NSXV3.nsxv3_ip_discovery_switching_profile = nsx-default-ip-discovery-vlan-profile {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.102622] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] NSXV3.nsxv3_login_hostname = nsxt.osci.c.eu-de-1.cloud.sap {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.102771] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] NSXV3.nsxv3_login_password = **** {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.102913] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] NSXV3.nsxv3_login_port = 443 {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.103061] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] NSXV3.nsxv3_login_user = admin {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.103201] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] NSXV3.nsxv3_managed_hosts = [] {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.103344] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] NSXV3.nsxv3_max_records_per_query = 200 {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.103475] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] NSXV3.nsxv3_operation_retry_count = 3 {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.103605] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] NSXV3.nsxv3_operation_retry_sleep = 5 {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.103740] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] NSXV3.nsxv3_realization_timeout = 300 {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.103879] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] NSXV3.nsxv3_remove_orphan_ports_after = 2.0 {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.104024] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] NSXV3.nsxv3_request_timeout = 60 {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.104164] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] NSXV3.nsxv3_requests_per_second = 80 {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.104296] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] NSXV3.nsxv3_requests_per_second_timeout = 7 {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.104433] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] NSXV3.nsxv3_spoof_guard_switching_profile = nsx-default-spoof-guard-vif-profile {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.104570] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] NSXV3.nsxv3_suppress_ssl_warnings = True {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.104702] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] NSXV3.nsxv3_transport_zone_id_cache_time = 86400 {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.104838] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] NSXV3.nsxv3_transport_zone_name = nsx-vlan-transportzone {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.105040] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] vsphere.vsphere_login_hostname = vc-l-01a.corp.local {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.105227] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] vsphere.vsphere_login_password = VMware1! {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.105352] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] vsphere.vsphere_login_username = administrator@vsphere.local {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.105490] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] vsphere.vsphere_suppress_ssl_wornings = True {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.105628] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] nova.auth_section = None {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.105772] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] nova.auth_type = password {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.105911] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] nova.cafile = /opt/stack/data/ca-bundle.pem {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.106054] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] nova.certfile = None {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.106190] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] nova.collect_timing = False {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.106334] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] nova.endpoint_type = public {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.106468] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] nova.insecure = False {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.106597] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] nova.keyfile = None {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.106734] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] nova.region_name = RegionOne {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.106867] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] nova.split_loggers = False {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.106996] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] nova.timeout = None {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.107147] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] placement.auth_section = None {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.107330] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] placement.auth_type = password {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.107494] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] placement.cafile = /opt/stack/data/ca-bundle.pem {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.107626] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] placement.certfile = None {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.107762] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] placement.collect_timing = False {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.107904] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] placement.endpoint_type = public {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.108043] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] placement.insecure = False {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.108180] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] placement.keyfile = None {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.108338] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] placement.region_name = None {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.108477] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] placement.split_loggers = False {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.108610] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] placement.timeout = None {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.108747] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] ironic.auth_section = None {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.108879] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] ironic.auth_type = None {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.109017] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] ironic.cafile = None {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.109150] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] ironic.certfile = None {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.109284] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] ironic.collect_timing = False {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.109416] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] ironic.connect_retries = None {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.109547] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] ironic.connect_retry_delay = None {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.109679] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] ironic.enable_notifications = False {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.109806] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] ironic.endpoint_override = None {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.109938] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] ironic.insecure = False {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.110077] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] ironic.interface = None {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.110210] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] ironic.keyfile = None {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.110343] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] ironic.max_version = None {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.110471] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] ironic.min_version = None {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.110597] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] ironic.region_name = None {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.110723] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] ironic.retriable_status_codes = None {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.110850] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] ironic.service_name = None {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.110978] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] ironic.service_type = None {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.111119] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] ironic.split_loggers = False {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.111249] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] ironic.status_code_retries = None {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.111376] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] ironic.status_code_retry_delay = None {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.111504] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] ironic.timeout = None {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.111631] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] ironic.valid_interfaces = None {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.111757] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] ironic.version = None {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.111895] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] cli_script.dry_run = False {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.112048] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.112183] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.112318] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.112450] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.112581] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.112710] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.112840] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.112970] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.113113] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.113253] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] oslo_messaging_rabbit.hostname = devstack {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.113383] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.113520] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.113657] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.113792] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.113923] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.114073] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] oslo_messaging_rabbit.processname = neutron-nsxv3-agent {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.114207] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.114337] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.114472] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.114603] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.114733] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.114861] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.114988] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.115133] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.115287] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.115428] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.115558] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.115690] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.115824] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.115957] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.116104] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] oslo_messaging_rabbit.ssl = False {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.116247] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.116389] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.116525] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.116660] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.116799] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] oslo_messaging_rabbit.ssl_version = {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.116930] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.117090] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] oslo_messaging_notifications.driver = [] {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.117264] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] oslo_messaging_notifications.retry = -1 {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.117410] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.117540] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] oslo_messaging_notifications.transport_url = **** {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.117642] env[65306]: DEBUG oslo_service.backend._eventlet.service [None req-350b1603-cb9f-40fd-886c-9f4c1b25615f None None] ******************************************************************************** {{(pid=65306) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2828}} [ 532.118827] env[65306]: DEBUG neutron.agent.securitygroups_rpc [None req-fe90dfa9-7944-46fc-be94-0b3a151ba91d None None] Init firewall settings (driver=nsxv3) {{(pid=65306) init_firewall /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:137}} [ 532.120179] env[65306]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.extensions.firewall [None req-fe90dfa9-7944-46fc-be94-0b3a151ba91d None None] Initializing NSXv3SecurityGroupsDriver dummy driver. {{(pid=65306) __init__ /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/extensions/firewall.py:16}} [ 532.120445] env[65306]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-fe90dfa9-7944-46fc-be94-0b3a151ba91d None None] RPC agent_id: nsxm-l-01a.corp.local [ 532.122703] env[65306]: DEBUG dogpile.cache.region [None req-fe90dfa9-7944-46fc-be94-0b3a151ba91d None None] No value present for key: 'zone-id' {{(pid=65306) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 532.122825] env[65306]: DEBUG dogpile.lock [None req-fe90dfa9-7944-46fc-be94-0b3a151ba91d None None] NeedRegenerationException {{(pid=65306) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 532.122930] env[65306]: DEBUG dogpile.lock [None req-fe90dfa9-7944-46fc-be94-0b3a151ba91d None None] no value, waiting for create lock {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 532.123029] env[65306]: DEBUG dogpile.lock [None req-fe90dfa9-7944-46fc-be94-0b3a151ba91d None None] value creation lock acquired {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 532.123128] env[65306]: DEBUG dogpile.cache.region [None req-fe90dfa9-7944-46fc-be94-0b3a151ba91d None None] No value present for key: 'zone-id' {{(pid=65306) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 532.123214] env[65306]: DEBUG dogpile.lock [None req-fe90dfa9-7944-46fc-be94-0b3a151ba91d None None] Calling creation function for not-yet-present value {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 532.123339] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fe90dfa9-7944-46fc-be94-0b3a151ba91d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 532.170263] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-fe90dfa9-7944-46fc-be94-0b3a151ba91d None None] Session token - acquiring [ 532.171831] env[65306]: DEBUG networking_nsxv3.common.locking [None req-fe90dfa9-7944-46fc-be94-0b3a151ba91d None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [, , , , , , , , , , , , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 532.172028] env[65306]: DEBUG oslo_concurrency.lockutils [None req-fe90dfa9-7944-46fc-be94-0b3a151ba91d None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 532.172170] env[65306]: DEBUG oslo_concurrency.lockutils [None req-fe90dfa9-7944-46fc-be94-0b3a151ba91d None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 532.172541] env[65306]: DEBUG oslo_concurrency.lockutils [None req-fe90dfa9-7944-46fc-be94-0b3a151ba91d None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 532.184568] env[65306]: DEBUG oslo_concurrency.lockutils [None req-fe90dfa9-7944-46fc-be94-0b3a151ba91d None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 532.464904] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-fe90dfa9-7944-46fc-be94-0b3a151ba91d None None] Session token - acquired, connected to NSX-T 4.1.2.0.0.22589037 [ 532.489834] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fe90dfa9-7944-46fc-be94-0b3a151ba91d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 532.490076] env[65306]: DEBUG dogpile.cache.region [None req-fe90dfa9-7944-46fc-be94-0b3a151ba91d None None] Cache value generated in 0.367 seconds for key(s): 'zone-id' {{(pid=65306) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 532.490076] env[65306]: DEBUG dogpile.lock [None req-fe90dfa9-7944-46fc-be94-0b3a151ba91d None None] Released creation lock {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 532.490220] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fe90dfa9-7944-46fc-be94-0b3a151ba91d None None] Activating Policy API Provider. [ 532.490572] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fe90dfa9-7944-46fc-be94-0b3a151ba91d None None] Looking for the default Infrastructure Rules. [ 532.567540] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fe90dfa9-7944-46fc-be94-0b3a151ba91d None None] Looking for the Default Layer3 Logged Drop Section. [ 532.586146] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-fe90dfa9-7944-46fc-be94-0b3a151ba91d None None] Detected NSX-T (4, 1, 2, 0, 0, 22589037) version. [ 532.586646] env[65306]: DEBUG networking_nsxv3.common.locking [None req-fe90dfa9-7944-46fc-be94-0b3a151ba91d None None] Lock all taken with stack trace [, , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 532.586816] env[65306]: DEBUG oslo_concurrency.lockutils [None req-fe90dfa9-7944-46fc-be94-0b3a151ba91d None None] Acquiring lock "all" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 532.586917] env[65306]: DEBUG oslo_concurrency.lockutils [None req-fe90dfa9-7944-46fc-be94-0b3a151ba91d None None] Acquired lock "all" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 532.587265] env[65306]: DEBUG oslo_concurrency.lockutils [None req-fe90dfa9-7944-46fc-be94-0b3a151ba91d None None] Acquired external semaphore "all" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 532.587614] env[65306]: DEBUG networking_nsxv3.api.rpc [None req-fe90dfa9-7944-46fc-be94-0b3a151ba91d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 533.102938] env[65306]: DEBUG networking_nsxv3.api.rpc [None req-fe90dfa9-7944-46fc-be94-0b3a151ba91d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 533.605787] env[65306]: DEBUG networking_nsxv3.api.rpc [None req-fe90dfa9-7944-46fc-be94-0b3a151ba91d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 534.108197] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-fe90dfa9-7944-46fc-be94-0b3a151ba91d None None] Inventory metadata is going to be refreshed. [ 534.108666] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fe90dfa9-7944-46fc-be94-0b3a151ba91d None None] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 534.918613] env[65306]: DEBUG networking_nsxv3.common.locking [None req-fe90dfa9-7944-46fc-be94-0b3a151ba91d None None] Lock Segment taken with stack trace [, , , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 534.918897] env[65306]: DEBUG oslo_concurrency.lockutils [None req-fe90dfa9-7944-46fc-be94-0b3a151ba91d None None] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 534.918897] env[65306]: DEBUG oslo_concurrency.lockutils [None req-fe90dfa9-7944-46fc-be94-0b3a151ba91d None None] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 534.919174] env[65306]: DEBUG oslo_concurrency.lockutils [None req-fe90dfa9-7944-46fc-be94-0b3a151ba91d None None] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 534.931165] env[65306]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [None req-fe90dfa9-7944-46fc-be94-0b3a151ba91d None None] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 534.933249] env[65306]: DEBUG oslo_concurrency.lockutils [None req-fe90dfa9-7944-46fc-be94-0b3a151ba91d None None] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 534.933886] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fe90dfa9-7944-46fc-be94-0b3a151ba91d None None] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 534.954432] env[65306]: DEBUG networking_nsxv3.common.locking [None req-fe90dfa9-7944-46fc-be94-0b3a151ba91d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 534.954738] env[65306]: DEBUG oslo_concurrency.lockutils [None req-fe90dfa9-7944-46fc-be94-0b3a151ba91d None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 534.954738] env[65306]: DEBUG oslo_concurrency.lockutils [None req-fe90dfa9-7944-46fc-be94-0b3a151ba91d None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 534.954995] env[65306]: DEBUG oslo_concurrency.lockutils [None req-fe90dfa9-7944-46fc-be94-0b3a151ba91d None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 534.955200] env[65306]: DEBUG oslo_concurrency.lockutils [None req-fe90dfa9-7944-46fc-be94-0b3a151ba91d None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 534.955364] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fe90dfa9-7944-46fc-be94-0b3a151ba91d None None] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 534.955500] env[65306]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fe90dfa9-7944-46fc-be94-0b3a151ba91d None None] Outdated resources of Type:SegmentPort Are:set() {{(pid=65306) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 534.955615] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fe90dfa9-7944-46fc-be94-0b3a151ba91d None None] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 534.975325] env[65306]: DEBUG networking_nsxv3.common.locking [None req-fe90dfa9-7944-46fc-be94-0b3a151ba91d None None] Lock Security Group (Rules) taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 534.975589] env[65306]: DEBUG oslo_concurrency.lockutils [None req-fe90dfa9-7944-46fc-be94-0b3a151ba91d None None] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 534.975589] env[65306]: DEBUG oslo_concurrency.lockutils [None req-fe90dfa9-7944-46fc-be94-0b3a151ba91d None None] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 534.975870] env[65306]: DEBUG oslo_concurrency.lockutils [None req-fe90dfa9-7944-46fc-be94-0b3a151ba91d None None] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 534.976055] env[65306]: DEBUG oslo_concurrency.lockutils [None req-fe90dfa9-7944-46fc-be94-0b3a151ba91d None None] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 534.976200] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fe90dfa9-7944-46fc-be94-0b3a151ba91d None None] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 534.996865] env[65306]: DEBUG networking_nsxv3.common.locking [None req-fe90dfa9-7944-46fc-be94-0b3a151ba91d None None] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 534.997138] env[65306]: DEBUG oslo_concurrency.lockutils [None req-fe90dfa9-7944-46fc-be94-0b3a151ba91d None None] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 534.997138] env[65306]: DEBUG oslo_concurrency.lockutils [None req-fe90dfa9-7944-46fc-be94-0b3a151ba91d None None] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 534.997613] env[65306]: DEBUG oslo_concurrency.lockutils [None req-fe90dfa9-7944-46fc-be94-0b3a151ba91d None None] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 534.997800] env[65306]: DEBUG oslo_concurrency.lockutils [None req-fe90dfa9-7944-46fc-be94-0b3a151ba91d None None] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 534.997955] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fe90dfa9-7944-46fc-be94-0b3a151ba91d None None] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 535.020323] env[65306]: DEBUG networking_nsxv3.common.locking [None req-fe90dfa9-7944-46fc-be94-0b3a151ba91d None None] Lock Address Group taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 535.020636] env[65306]: DEBUG oslo_concurrency.lockutils [None req-fe90dfa9-7944-46fc-be94-0b3a151ba91d None None] Acquiring lock "Address Group" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 535.020702] env[65306]: DEBUG oslo_concurrency.lockutils [None req-fe90dfa9-7944-46fc-be94-0b3a151ba91d None None] Acquired lock "Address Group" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 535.021112] env[65306]: DEBUG oslo_concurrency.lockutils [None req-fe90dfa9-7944-46fc-be94-0b3a151ba91d None None] Acquired external semaphore "Address Group" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 535.021308] env[65306]: DEBUG oslo_concurrency.lockutils [None req-fe90dfa9-7944-46fc-be94-0b3a151ba91d None None] Releasing lock "Address Group" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 535.021520] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fe90dfa9-7944-46fc-be94-0b3a151ba91d None None] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:0. [ 535.021668] env[65306]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fe90dfa9-7944-46fc-be94-0b3a151ba91d None None] Outdated resources of Type:Security Group (Rules) Are:set() {{(pid=65306) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 535.021813] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fe90dfa9-7944-46fc-be94-0b3a151ba91d None None] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 535.045651] env[65306]: DEBUG networking_nsxv3.common.locking [None req-fe90dfa9-7944-46fc-be94-0b3a151ba91d None None] Lock Segment QoS taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 535.045947] env[65306]: DEBUG oslo_concurrency.lockutils [None req-fe90dfa9-7944-46fc-be94-0b3a151ba91d None None] Acquiring lock "Segment QoS" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 535.045947] env[65306]: DEBUG oslo_concurrency.lockutils [None req-fe90dfa9-7944-46fc-be94-0b3a151ba91d None None] Acquired lock "Segment QoS" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 535.046257] env[65306]: DEBUG oslo_concurrency.lockutils [None req-fe90dfa9-7944-46fc-be94-0b3a151ba91d None None] Acquired external semaphore "Segment QoS" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 535.046384] env[65306]: DEBUG oslo_concurrency.lockutils [None req-fe90dfa9-7944-46fc-be94-0b3a151ba91d None None] Releasing lock "Segment QoS" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 535.046530] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fe90dfa9-7944-46fc-be94-0b3a151ba91d None None] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 535.046631] env[65306]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fe90dfa9-7944-46fc-be94-0b3a151ba91d None None] Outdated resources of Type:Segment QoS Are:set() {{(pid=65306) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 535.046733] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fe90dfa9-7944-46fc-be94-0b3a151ba91d None None] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 535.068747] env[65306]: DEBUG networking_nsxv3.common.locking [None req-fe90dfa9-7944-46fc-be94-0b3a151ba91d None None] Lock Security Group (Members) taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 535.069082] env[65306]: DEBUG oslo_concurrency.lockutils [None req-fe90dfa9-7944-46fc-be94-0b3a151ba91d None None] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 535.069082] env[65306]: DEBUG oslo_concurrency.lockutils [None req-fe90dfa9-7944-46fc-be94-0b3a151ba91d None None] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 535.069347] env[65306]: DEBUG oslo_concurrency.lockutils [None req-fe90dfa9-7944-46fc-be94-0b3a151ba91d None None] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 535.069490] env[65306]: DEBUG oslo_concurrency.lockutils [None req-fe90dfa9-7944-46fc-be94-0b3a151ba91d None None] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 535.069705] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fe90dfa9-7944-46fc-be94-0b3a151ba91d None None] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 535.069812] env[65306]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fe90dfa9-7944-46fc-be94-0b3a151ba91d None None] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=65306) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 535.069911] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-fe90dfa9-7944-46fc-be94-0b3a151ba91d None None] Inventory metadata have been refreshed. [ 535.070016] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-fe90dfa9-7944-46fc-be94-0b3a151ba91d None None] Dryrun:True. Metadata refresh completed. [ 535.070133] env[65306]: DEBUG oslo_concurrency.lockutils [None req-fe90dfa9-7944-46fc-be94-0b3a151ba91d None None] Releasing lock "all" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 535.071773] env[65306]: INFO neutron.agent.agent_extensions_manager [None req-fe90dfa9-7944-46fc-be94-0b3a151ba91d None None] Loaded agent extensions: [] [ 535.072494] env[65306]: DEBUG neutron_lib.callbacks.manager [None req-fe90dfa9-7944-46fc-be94-0b3a151ba91d None None] Publish callbacks [] for NSXv3 Agent (None), after_init {{(pid=65306) _notify_loop /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:184}} [ 535.121209] env[65306]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-fe90dfa9-7944-46fc-be94-0b3a151ba91d None None] NSXv3 Agent Agent RPC Daemon Started! [ 535.121608] env[65306]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-fe90dfa9-7944-46fc-be94-0b3a151ba91d None None] NSXv3 Agent Agent loop - iteration:0 started [ 535.121608] env[65306]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-fe90dfa9-7944-46fc-be94-0b3a151ba91d None None] NSXv3 Agent Agent out of sync with plugin! [ 540.073238] env[65306]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 540.073238] env[65306]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 545.074855] env[65306]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 545.075332] env[65306]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 550.075809] env[65306]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 550.076186] env[65306]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 550.142582] env[65306]: INFO networking_nsxv3.common.synchronization [None req-5ffbae2e-77f5-4a9d-ba83-e9d588e91caf demo admin] Enqueued Resource ID: 6b2d34c9-4df9-40b0-a12c-29a187c8e5e7 with Priority: HIGHEST for action security_group_rules [ 550.143145] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6b2d34c9-4df9-40b0-a12c-29a187c8e5e7 with Priority: HIGHEST for action security_group_rules [ 550.143485] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6b2d34c9-4df9-40b0-a12c-29a187c8e5e7 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 550.143610] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6b2d34c9-4df9-40b0-a12c-29a187c8e5e7" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 550.143680] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6b2d34c9-4df9-40b0-a12c-29a187c8e5e7" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 550.144212] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6b2d34c9-4df9-40b0-a12c-29a187c8e5e7" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 550.144283] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6b2d34c9-4df9-40b0-a12c-29a187c8e5e7',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 550.665431] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 550.665649] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 550.665699] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 550.665916] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 550.666039] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 550.666209] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6b2d34c9-4df9-40b0-a12c-29a187c8e5e7 already deleted. [ 550.666343] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6b2d34c9-4df9-40b0-a12c-29a187c8e5e7" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 555.143824] env[65306]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 555.144241] env[65306]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 560.076061] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 560.076061] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 560.076061] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 560.076680] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 560.076680] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 560.145078] env[65306]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 560.145376] env[65306]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 560.579747] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 561.081668] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 561.584069] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 561.584269] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 562.277224] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 562.277641] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 562.277641] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 562.277792] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 562.291175] env[65306]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 562.292094] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 562.292793] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 562.310626] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 562.310830] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 562.310875] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 562.311122] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 562.311223] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 562.311357] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 562.311447] env[65306]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=65306) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 562.311532] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 562.330737] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 562.330931] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 562.330988] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 562.331192] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 562.331322] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 562.331433] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 562.350238] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 562.350451] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 562.350451] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 562.350621] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 562.350722] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 562.350828] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 562.368201] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 562.368402] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 562.368402] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 562.368602] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 562.368707] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 562.368816] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:0. [ 562.368891] env[65306]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:set() {{(pid=65306) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 562.368962] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 562.387519] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 562.387735] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 562.387835] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 562.388046] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 562.388138] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 562.388251] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 562.388324] env[65306]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=65306) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 562.388396] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 562.409662] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 562.409895] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 562.409895] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 562.410090] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 562.410194] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 562.410312] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 562.410386] env[65306]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=65306) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 562.410455] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 562.410522] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 562.410616] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Security Group Rules [ 562.410654] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Security Group Members [ 562.410712] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:QoS [ 562.410993] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Items outdated since last Agent sanitize:0 [ 562.411082] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Sanitizing provider based on age cycles [ 562.411153] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 562.430218] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 562.430444] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 562.430444] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 562.430595] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 562.430716] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 562.430837] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 562.448760] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 562.448948] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 562.448995] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 562.449177] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 562.449273] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 562.461953] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 565.146137] env[65306]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 565.146549] env[65306]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 570.147028] env[65306]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 570.150263] env[65306]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 575.148394] env[65306]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 575.148660] env[65306]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 577.411862] env[65306]: INFO networking_nsxv3.common.synchronization [None req-5e032e30-756a-48d8-ba7d-6c261bad9724 None None] Enqueued Resource ID: 34e79d19-6246-4bda-b226-ea3b30fa5dd2 with Priority: HIGHEST for action port [ 577.411862] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 34e79d19-6246-4bda-b226-ea3b30fa5dd2 with Priority: HIGHEST for action port [ 577.411862] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock port-34e79d19-6246-4bda-b226-ea3b30fa5dd2 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 577.411862] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-34e79d19-6246-4bda-b226-ea3b30fa5dd2" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 577.411862] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-34e79d19-6246-4bda-b226-ea3b30fa5dd2" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 577.412849] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-34e79d19-6246-4bda-b226-ea3b30fa5dd2" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 577.413024] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('34e79d19-6246-4bda-b226-ea3b30fa5dd2',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 577.916420] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 34e79d19-6246-4bda-b226-ea3b30fa5dd2 [ 577.916420] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 577.916420] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 577.916420] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 577.916420] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 577.916420] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 577.916420] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:34e79d19-6246-4bda-b226-ea3b30fa5dd2 already deleted. [ 577.916420] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-34e79d19-6246-4bda-b226-ea3b30fa5dd2" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 579.294019] env[65306]: INFO networking_nsxv3.common.synchronization [None req-d811ca8e-a53a-465f-8de2-e207b2ae6260 None None] Enqueued Resource ID: 2b2afe9d-1edc-420f-a2b3-1f2c03a7b2a1 with Priority: HIGHEST for action port [ 579.294019] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2b2afe9d-1edc-420f-a2b3-1f2c03a7b2a1 with Priority: HIGHEST for action port [ 579.294019] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock port-2b2afe9d-1edc-420f-a2b3-1f2c03a7b2a1 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 579.294019] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2b2afe9d-1edc-420f-a2b3-1f2c03a7b2a1" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 579.294019] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2b2afe9d-1edc-420f-a2b3-1f2c03a7b2a1" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 579.294019] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2b2afe9d-1edc-420f-a2b3-1f2c03a7b2a1" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 579.294019] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2b2afe9d-1edc-420f-a2b3-1f2c03a7b2a1',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 579.796923] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2b2afe9d-1edc-420f-a2b3-1f2c03a7b2a1 [ 579.796923] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 579.796923] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 579.797262] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 579.797262] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 579.797371] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 579.797371] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2b2afe9d-1edc-420f-a2b3-1f2c03a7b2a1 already deleted. [ 579.797473] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2b2afe9d-1edc-420f-a2b3-1f2c03a7b2a1" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 581.145486] env[65306]: INFO networking_nsxv3.common.synchronization [None req-f6f6e693-d01e-46b8-af23-b12aaf4166a5 None None] Enqueued Resource ID: b86a3dad-0492-4dfc-bee6-ca03c28c425c with Priority: HIGHEST for action port [ 581.145758] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b86a3dad-0492-4dfc-bee6-ca03c28c425c with Priority: HIGHEST for action port [ 581.146156] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock port-b86a3dad-0492-4dfc-bee6-ca03c28c425c taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 581.146231] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b86a3dad-0492-4dfc-bee6-ca03c28c425c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 581.146296] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b86a3dad-0492-4dfc-bee6-ca03c28c425c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 581.146532] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b86a3dad-0492-4dfc-bee6-ca03c28c425c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 581.146618] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b86a3dad-0492-4dfc-bee6-ca03c28c425c',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 581.394711] env[65306]: INFO networking_nsxv3.common.synchronization [None req-df598096-a38e-41bf-b8b6-4ce5b59150b6 None None] Enqueued Resource ID: 0d8f6c73-77a2-4ab0-b414-fa109726feb6 with Priority: HIGHEST for action port [ 581.394962] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0d8f6c73-77a2-4ab0-b414-fa109726feb6 with Priority: HIGHEST for action port [ 581.397658] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock port-0d8f6c73-77a2-4ab0-b414-fa109726feb6 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 581.397796] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0d8f6c73-77a2-4ab0-b414-fa109726feb6" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 581.397837] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0d8f6c73-77a2-4ab0-b414-fa109726feb6" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 581.398150] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0d8f6c73-77a2-4ab0-b414-fa109726feb6" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 581.398237] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0d8f6c73-77a2-4ab0-b414-fa109726feb6',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 581.652849] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b86a3dad-0492-4dfc-bee6-ca03c28c425c [ 581.655265] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 581.655265] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 581.655265] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 581.655265] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 581.655265] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 581.655265] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b86a3dad-0492-4dfc-bee6-ca03c28c425c already deleted. [ 581.655265] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b86a3dad-0492-4dfc-bee6-ca03c28c425c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 581.903296] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0d8f6c73-77a2-4ab0-b414-fa109726feb6 [ 581.903296] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 581.903296] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 581.903296] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 581.903296] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 581.903296] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 581.903486] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0d8f6c73-77a2-4ab0-b414-fa109726feb6 already deleted. [ 581.903486] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0d8f6c73-77a2-4ab0-b414-fa109726feb6" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 582.072838] env[65306]: INFO networking_nsxv3.common.synchronization [None req-fdc5b996-6551-493f-a109-9000904cee89 None None] Enqueued Resource ID: f9ba8090-5e58-4221-95b0-35608c0fba12 with Priority: HIGHEST for action port [ 582.072838] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f9ba8090-5e58-4221-95b0-35608c0fba12 with Priority: HIGHEST for action port [ 582.073154] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock port-f9ba8090-5e58-4221-95b0-35608c0fba12 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 582.073898] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f9ba8090-5e58-4221-95b0-35608c0fba12" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 582.073898] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f9ba8090-5e58-4221-95b0-35608c0fba12" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 582.073898] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f9ba8090-5e58-4221-95b0-35608c0fba12" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 582.073898] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f9ba8090-5e58-4221-95b0-35608c0fba12',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 582.577100] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f9ba8090-5e58-4221-95b0-35608c0fba12 [ 582.578182] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 582.578299] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 582.578339] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 582.578884] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 582.578884] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 582.578884] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f9ba8090-5e58-4221-95b0-35608c0fba12 already deleted. [ 582.578884] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f9ba8090-5e58-4221-95b0-35608c0fba12" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 583.560944] env[65306]: INFO networking_nsxv3.common.synchronization [None req-c5f6330b-f9a3-4caf-8c37-b4435b57bd0e None None] Enqueued Resource ID: d15fdad1-65e8-4bc1-b454-806ac9653077 with Priority: HIGHEST for action port [ 583.561211] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d15fdad1-65e8-4bc1-b454-806ac9653077 with Priority: HIGHEST for action port [ 583.561761] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock port-d15fdad1-65e8-4bc1-b454-806ac9653077 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 583.561886] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d15fdad1-65e8-4bc1-b454-806ac9653077" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 583.561958] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d15fdad1-65e8-4bc1-b454-806ac9653077" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 583.563483] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d15fdad1-65e8-4bc1-b454-806ac9653077" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 583.563678] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d15fdad1-65e8-4bc1-b454-806ac9653077',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 584.065805] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d15fdad1-65e8-4bc1-b454-806ac9653077 [ 584.066132] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 584.066219] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 584.066287] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 584.066499] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 584.066568] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 584.066658] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d15fdad1-65e8-4bc1-b454-806ac9653077 already deleted. [ 584.066735] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d15fdad1-65e8-4bc1-b454-806ac9653077" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 584.090648] env[65306]: INFO networking_nsxv3.common.synchronization [None req-577c273c-b30d-4fe9-af75-b333664be368 None None] Enqueued Resource ID: 3d773b3b-69ad-4c96-861f-6762acd19ba2 with Priority: HIGHEST for action port [ 584.092029] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3d773b3b-69ad-4c96-861f-6762acd19ba2 with Priority: HIGHEST for action port [ 584.092466] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock port-3d773b3b-69ad-4c96-861f-6762acd19ba2 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 584.093040] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3d773b3b-69ad-4c96-861f-6762acd19ba2" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 584.093040] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3d773b3b-69ad-4c96-861f-6762acd19ba2" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 584.093040] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3d773b3b-69ad-4c96-861f-6762acd19ba2" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 584.093040] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3d773b3b-69ad-4c96-861f-6762acd19ba2',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 584.595238] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3d773b3b-69ad-4c96-861f-6762acd19ba2 [ 584.595482] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 584.595621] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 584.595692] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 584.595903] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 584.596038] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 584.596134] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3d773b3b-69ad-4c96-861f-6762acd19ba2 already deleted. [ 584.596219] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3d773b3b-69ad-4c96-861f-6762acd19ba2" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 585.294788] env[65306]: INFO networking_nsxv3.common.synchronization [None req-28c80dd0-67cc-4153-b061-5d7a029ab181 None None] Enqueued Resource ID: 4ff6e1cc-1368-4c50-809a-e6d1ede265e0 with Priority: HIGHEST for action port [ 585.295039] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4ff6e1cc-1368-4c50-809a-e6d1ede265e0 with Priority: HIGHEST for action port [ 585.295608] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock port-4ff6e1cc-1368-4c50-809a-e6d1ede265e0 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 585.295737] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4ff6e1cc-1368-4c50-809a-e6d1ede265e0" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 585.295808] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4ff6e1cc-1368-4c50-809a-e6d1ede265e0" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 585.296976] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4ff6e1cc-1368-4c50-809a-e6d1ede265e0" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 585.297549] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4ff6e1cc-1368-4c50-809a-e6d1ede265e0',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 585.687446] env[65306]: INFO networking_nsxv3.common.synchronization [None req-987e48a9-7217-471a-a993-b247acf74f2f None None] Enqueued Resource ID: 452fc212-2e3c-474c-9966-acf70cfaafbc with Priority: HIGHEST for action port [ 585.687701] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 452fc212-2e3c-474c-9966-acf70cfaafbc with Priority: HIGHEST for action port [ 585.688430] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock port-452fc212-2e3c-474c-9966-acf70cfaafbc taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 585.688617] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-452fc212-2e3c-474c-9966-acf70cfaafbc" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 585.688713] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-452fc212-2e3c-474c-9966-acf70cfaafbc" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 585.689178] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-452fc212-2e3c-474c-9966-acf70cfaafbc" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 585.689296] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('452fc212-2e3c-474c-9966-acf70cfaafbc',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 585.800370] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4ff6e1cc-1368-4c50-809a-e6d1ede265e0 [ 585.801200] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 585.803479] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 585.803479] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 585.803479] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 585.803479] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 585.803479] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4ff6e1cc-1368-4c50-809a-e6d1ede265e0 already deleted. [ 585.803479] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4ff6e1cc-1368-4c50-809a-e6d1ede265e0" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.191400] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 452fc212-2e3c-474c-9966-acf70cfaafbc [ 586.191735] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.191831] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.191831] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.192058] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.192154] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.192272] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:452fc212-2e3c-474c-9966-acf70cfaafbc already deleted. [ 586.192365] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-452fc212-2e3c-474c-9966-acf70cfaafbc" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.296869] env[65306]: INFO networking_nsxv3.common.synchronization [None req-c404c469-b105-4815-b8bd-47e938c1b5c6 None None] Enqueued Resource ID: 223de490-49dc-4c76-8ef8-91f960f89eb4 with Priority: HIGHEST for action port [ 586.297445] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 223de490-49dc-4c76-8ef8-91f960f89eb4 with Priority: HIGHEST for action port [ 586.297755] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock port-223de490-49dc-4c76-8ef8-91f960f89eb4 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.297876] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-223de490-49dc-4c76-8ef8-91f960f89eb4" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.297962] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-223de490-49dc-4c76-8ef8-91f960f89eb4" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.298283] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-223de490-49dc-4c76-8ef8-91f960f89eb4" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.298366] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('223de490-49dc-4c76-8ef8-91f960f89eb4',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 586.606963] env[65306]: INFO networking_nsxv3.common.synchronization [None req-5d522654-eb7d-446a-a1f7-3f5489269ae4 None None] Enqueued Resource ID: ef06b8d5-0eb3-455f-a2f7-769547bb2a7c with Priority: HIGHEST for action port [ 586.607569] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ef06b8d5-0eb3-455f-a2f7-769547bb2a7c with Priority: HIGHEST for action port [ 586.607892] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock port-ef06b8d5-0eb3-455f-a2f7-769547bb2a7c taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.607993] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ef06b8d5-0eb3-455f-a2f7-769547bb2a7c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.608662] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ef06b8d5-0eb3-455f-a2f7-769547bb2a7c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.609267] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ef06b8d5-0eb3-455f-a2f7-769547bb2a7c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.609371] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ef06b8d5-0eb3-455f-a2f7-769547bb2a7c',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 586.801264] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 223de490-49dc-4c76-8ef8-91f960f89eb4 [ 586.801264] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.801264] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.801264] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.801264] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.801508] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.801508] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:223de490-49dc-4c76-8ef8-91f960f89eb4 already deleted. [ 586.801508] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-223de490-49dc-4c76-8ef8-91f960f89eb4" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.113315] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ef06b8d5-0eb3-455f-a2f7-769547bb2a7c [ 587.113564] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.113711] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.113755] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.113949] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.114092] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.114152] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ef06b8d5-0eb3-455f-a2f7-769547bb2a7c already deleted. [ 587.114236] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ef06b8d5-0eb3-455f-a2f7-769547bb2a7c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.942660] env[65306]: INFO networking_nsxv3.common.synchronization [None req-f842445d-b11d-476b-ba4a-2fcb4e376462 None None] Enqueued Resource ID: e288eb06-b1ec-47d8-afdf-f32c37e87c1c with Priority: HIGHEST for action port [ 587.943045] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e288eb06-b1ec-47d8-afdf-f32c37e87c1c with Priority: HIGHEST for action port [ 587.943645] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock port-e288eb06-b1ec-47d8-afdf-f32c37e87c1c taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.943645] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e288eb06-b1ec-47d8-afdf-f32c37e87c1c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.943645] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e288eb06-b1ec-47d8-afdf-f32c37e87c1c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.943899] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e288eb06-b1ec-47d8-afdf-f32c37e87c1c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.944031] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e288eb06-b1ec-47d8-afdf-f32c37e87c1c',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 588.449492] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e288eb06-b1ec-47d8-afdf-f32c37e87c1c [ 588.449744] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.449882] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.449952] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.450190] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.450289] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.450388] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e288eb06-b1ec-47d8-afdf-f32c37e87c1c already deleted. [ 588.450503] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e288eb06-b1ec-47d8-afdf-f32c37e87c1c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.496908] env[65306]: INFO networking_nsxv3.common.synchronization [None req-8d48ea5c-5af4-4bcc-8d72-7e1d02c06821 None None] Enqueued Resource ID: beb06694-81f0-4486-bf9e-5a01278be185 with Priority: HIGHEST for action port [ 589.497587] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: beb06694-81f0-4486-bf9e-5a01278be185 with Priority: HIGHEST for action port [ 589.499664] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock port-beb06694-81f0-4486-bf9e-5a01278be185 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.499664] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-beb06694-81f0-4486-bf9e-5a01278be185" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.499664] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-beb06694-81f0-4486-bf9e-5a01278be185" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.500551] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-beb06694-81f0-4486-bf9e-5a01278be185" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.500551] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('beb06694-81f0-4486-bf9e-5a01278be185',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 590.002359] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port beb06694-81f0-4486-bf9e-5a01278be185 [ 590.003644] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.003796] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.003871] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.004104] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.004200] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.004299] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:beb06694-81f0-4486-bf9e-5a01278be185 already deleted. [ 590.004384] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-beb06694-81f0-4486-bf9e-5a01278be185" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.225157] env[65306]: INFO networking_nsxv3.common.synchronization [None req-b2aaea9c-969b-4da6-9cff-c2eec65dffee None None] Enqueued Resource ID: 2ca042e6-97c0-4a81-a882-147786092f01 with Priority: HIGHEST for action port [ 590.225157] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2ca042e6-97c0-4a81-a882-147786092f01 with Priority: HIGHEST for action port [ 590.225157] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock port-2ca042e6-97c0-4a81-a882-147786092f01 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.225157] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2ca042e6-97c0-4a81-a882-147786092f01" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.225157] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2ca042e6-97c0-4a81-a882-147786092f01" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.225157] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2ca042e6-97c0-4a81-a882-147786092f01" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.225725] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2ca042e6-97c0-4a81-a882-147786092f01',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 590.729518] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2ca042e6-97c0-4a81-a882-147786092f01 [ 590.729776] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.729901] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.729973] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.730206] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.730303] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.730397] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2ca042e6-97c0-4a81-a882-147786092f01 already deleted. [ 590.730482] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2ca042e6-97c0-4a81-a882-147786092f01" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.890156] env[65306]: INFO networking_nsxv3.common.synchronization [None req-4fea8047-0fa2-47a1-8368-4b2a75915022 tempest-ServersTestFqdnHostnames-1995899657 tempest-ServersTestFqdnHostnames-1995899657-project-member] Enqueued Resource ID: 830915ca-b7ed-480d-8dcc-06210706a96a with Priority: HIGHEST for action security_group_rules [ 590.890156] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 830915ca-b7ed-480d-8dcc-06210706a96a with Priority: HIGHEST for action security_group_rules [ 590.890156] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock rules-830915ca-b7ed-480d-8dcc-06210706a96a taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.890156] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-830915ca-b7ed-480d-8dcc-06210706a96a" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.890156] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-830915ca-b7ed-480d-8dcc-06210706a96a" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.890156] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-830915ca-b7ed-480d-8dcc-06210706a96a" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.890156] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('830915ca-b7ed-480d-8dcc-06210706a96a',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 591.275896] env[65306]: INFO networking_nsxv3.common.synchronization [req-172f610c-ce9e-4d0a-add4-3296d627d2ef req-7289ffe1-8558-4c24-9c9c-86ed925e0f06 tempest-FloatingIPsAssociationNegativeTestJSON-748270145 tempest-FloatingIPsAssociationNegativeTestJSON-748270145-project-member] Enqueued Resource ID: 46299e31-1097-4753-8f76-35280209d73c with Priority: HIGHEST for action security_group_members [ 591.275896] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 46299e31-1097-4753-8f76-35280209d73c with Priority: HIGHEST for action security_group_members [ 591.275896] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-46299e31-1097-4753-8f76-35280209d73c taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.275896] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-46299e31-1097-4753-8f76-35280209d73c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.275896] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-46299e31-1097-4753-8f76-35280209d73c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.275896] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-46299e31-1097-4753-8f76-35280209d73c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.275896] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.277957] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.277957] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.277957] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.277957] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.277957] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('46299e31-1097-4753-8f76-35280209d73c',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 591.415170] env[65306]: INFO networking_nsxv3.common.synchronization [None req-ddcbc683-0890-4c9d-a2e2-bb9daaadd4eb tempest-ServersTestFqdnHostnames-1995899657 tempest-ServersTestFqdnHostnames-1995899657-project-member] Enqueued Resource ID: 830915ca-b7ed-480d-8dcc-06210706a96a with Priority: HIGHEST for action security_group_rules [ 591.417395] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.417617] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.417760] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.418113] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.418332] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.418442] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 830915ca-b7ed-480d-8dcc-06210706a96a already deleted. [ 591.418602] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-830915ca-b7ed-480d-8dcc-06210706a96a" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.419562] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 830915ca-b7ed-480d-8dcc-06210706a96a with Priority: HIGHEST for action security_group_rules [ 591.419991] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock rules-830915ca-b7ed-480d-8dcc-06210706a96a taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.422459] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-830915ca-b7ed-480d-8dcc-06210706a96a" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.422459] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-830915ca-b7ed-480d-8dcc-06210706a96a" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.422459] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-830915ca-b7ed-480d-8dcc-06210706a96a" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.422459] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('830915ca-b7ed-480d-8dcc-06210706a96a',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 591.644905] env[65306]: INFO networking_nsxv3.common.synchronization [None req-bf1c382f-f46e-4f9a-8fb0-a6e717a0e0ec None None] Enqueued Resource ID: c58ba474-4481-447d-9fb7-790c23cc34bf with Priority: HIGHEST for action port [ 591.645505] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c58ba474-4481-447d-9fb7-790c23cc34bf with Priority: HIGHEST for action port [ 591.645851] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock port-c58ba474-4481-447d-9fb7-790c23cc34bf taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.649382] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c58ba474-4481-447d-9fb7-790c23cc34bf" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.649382] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c58ba474-4481-447d-9fb7-790c23cc34bf" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.649547] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c58ba474-4481-447d-9fb7-790c23cc34bf" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.650928] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c58ba474-4481-447d-9fb7-790c23cc34bf',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 591.764480] env[65306]: INFO networking_nsxv3.common.synchronization [None req-67b3be44-e378-4d34-a969-cd686752bd6e None None] Enqueued Resource ID: 4ca8607f-e9af-4a08-8c71-7d910898511d with Priority: HIGHEST for action port [ 591.764874] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4ca8607f-e9af-4a08-8c71-7d910898511d with Priority: HIGHEST for action port [ 591.765279] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock port-4ca8607f-e9af-4a08-8c71-7d910898511d taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.765427] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4ca8607f-e9af-4a08-8c71-7d910898511d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.765499] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4ca8607f-e9af-4a08-8c71-7d910898511d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.765763] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4ca8607f-e9af-4a08-8c71-7d910898511d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.765866] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4ca8607f-e9af-4a08-8c71-7d910898511d',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 591.779787] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.779924] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.779960] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.781391] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.781391] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.781391] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.781391] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.781391] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.781391] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.781391] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.781391] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 46299e31-1097-4753-8f76-35280209d73c already deleted. [ 591.781391] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-46299e31-1097-4753-8f76-35280209d73c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.947794] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.947979] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.948086] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.948387] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.948501] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.948623] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 830915ca-b7ed-480d-8dcc-06210706a96a already deleted. [ 591.948721] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-830915ca-b7ed-480d-8dcc-06210706a96a" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.153902] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c58ba474-4481-447d-9fb7-790c23cc34bf [ 592.154228] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.154611] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.154784] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.155022] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.155115] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.155214] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c58ba474-4481-447d-9fb7-790c23cc34bf already deleted. [ 592.155295] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c58ba474-4481-447d-9fb7-790c23cc34bf" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.270161] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4ca8607f-e9af-4a08-8c71-7d910898511d [ 592.270409] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.270544] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.270667] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.270822] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.270964] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.271044] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4ca8607f-e9af-4a08-8c71-7d910898511d already deleted. [ 592.271907] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4ca8607f-e9af-4a08-8c71-7d910898511d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.561389] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock network-191 taken with stack trace [, , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.561587] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "network-191" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.561702] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "network-191" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.561997] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "network-191" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.562342] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.562915] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.562915] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.562915] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.563092] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.563277] env[65306]: DEBUG dogpile.cache.region [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] No value present for key: 'zone-id' {{(pid=65306) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 592.563384] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] NeedRegenerationException {{(pid=65306) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 592.563484] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] no value, waiting for create lock {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 592.563589] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] value creation lock acquired {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 592.564538] env[65306]: DEBUG dogpile.cache.region [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] No value present for key: 'zone-id' {{(pid=65306) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 592.564538] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Calling creation function for not-yet-present value {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 592.564538] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 592.583885] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 592.583885] env[65306]: DEBUG dogpile.cache.region [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65306) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 592.583885] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Released creation lock {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 592.584175] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "network-191" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.584355] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock port-1391178e-1c76-4d0a-8b55-f2895525073d taken with stack trace [, , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.584504] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "port-1391178e-1c76-4d0a-8b55-f2895525073d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.584715] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "port-1391178e-1c76-4d0a-8b55-f2895525073d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.584978] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "port-1391178e-1c76-4d0a-8b55-f2895525073d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.585087] env[65306]: DEBUG networking_nsxv3.api.rpc [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1391178e-1c76-4d0a-8b55-f2895525073d',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 592.685027] env[65306]: INFO networking_nsxv3.common.synchronization [None req-26aa241d-0880-433d-b2bf-84c69b0f1cd7 None None] Enqueued Resource ID: 2e3c2c8c-e84a-4120-97b6-7cefd6ba8b21 with Priority: HIGHEST for action port [ 592.685709] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2e3c2c8c-e84a-4120-97b6-7cefd6ba8b21 with Priority: HIGHEST for action port [ 592.685709] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock port-2e3c2c8c-e84a-4120-97b6-7cefd6ba8b21 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.686031] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2e3c2c8c-e84a-4120-97b6-7cefd6ba8b21" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.686031] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2e3c2c8c-e84a-4120-97b6-7cefd6ba8b21" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.686239] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2e3c2c8c-e84a-4120-97b6-7cefd6ba8b21" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.686326] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2e3c2c8c-e84a-4120-97b6-7cefd6ba8b21',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 593.035839] env[65306]: INFO networking_nsxv3.common.synchronization [None req-f5dc132c-73c0-4a91-8f9f-71de24b6cb7b None None] Enqueued Resource ID: 3861e9c2-95e5-4cfc-a254-3e14c8a43e10 with Priority: HIGHEST for action port [ 593.035839] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3861e9c2-95e5-4cfc-a254-3e14c8a43e10 with Priority: HIGHEST for action port [ 593.036185] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock port-3861e9c2-95e5-4cfc-a254-3e14c8a43e10 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.036185] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3861e9c2-95e5-4cfc-a254-3e14c8a43e10" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.036291] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3861e9c2-95e5-4cfc-a254-3e14c8a43e10" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.036509] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3861e9c2-95e5-4cfc-a254-3e14c8a43e10" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.036586] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3861e9c2-95e5-4cfc-a254-3e14c8a43e10',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 593.090212] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.090775] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.090775] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.090884] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.091309] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.091309] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Segment Port 1391178e-1c76-4d0a-8b55-f2895525073d not found, creating... [ 593.091402] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.091596] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.091596] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.091801] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.091926] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.092331] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.092492] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.092648] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.094108] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.094108] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.094108] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Resource: SegmentPort with ID: 1391178e-1c76-4d0a-8b55-f2895525073d is going to be created. [ 593.119791] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.120102] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.120155] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.120399] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.120670] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.120883] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "port-1391178e-1c76-4d0a-8b55-f2895525073d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.189476] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2e3c2c8c-e84a-4120-97b6-7cefd6ba8b21 [ 593.189710] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.189848] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.189916] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.190154] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.190740] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.190740] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2e3c2c8c-e84a-4120-97b6-7cefd6ba8b21 already deleted. [ 593.190740] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2e3c2c8c-e84a-4120-97b6-7cefd6ba8b21" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.538432] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3861e9c2-95e5-4cfc-a254-3e14c8a43e10 [ 593.538669] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.538803] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.538874] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.539111] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.539245] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.539299] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3861e9c2-95e5-4cfc-a254-3e14c8a43e10 already deleted. [ 593.539368] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3861e9c2-95e5-4cfc-a254-3e14c8a43e10" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.933294] env[65306]: INFO networking_nsxv3.common.synchronization [req-172f610c-ce9e-4d0a-add4-3296d627d2ef req-922446ec-8748-4cb1-a898-d458cf02c1c5 service nova] Enqueued Resource ID: 46299e31-1097-4753-8f76-35280209d73c with Priority: HIGHEST for action security_group_rules [ 593.933513] env[65306]: INFO networking_nsxv3.common.synchronization [req-172f610c-ce9e-4d0a-add4-3296d627d2ef req-922446ec-8748-4cb1-a898-d458cf02c1c5 service nova] Enqueued Resource ID: 46299e31-1097-4753-8f76-35280209d73c with Priority: HIGHEST for action security_group_members [ 593.933681] env[65306]: INFO networking_nsxv3.common.synchronization [req-172f610c-ce9e-4d0a-add4-3296d627d2ef req-922446ec-8748-4cb1-a898-d458cf02c1c5 service nova] Enqueued Resource ID: 1391178e-1c76-4d0a-8b55-f2895525073d with Priority: HIGHEST for action port [ 593.934307] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 46299e31-1097-4753-8f76-35280209d73c with Priority: HIGHEST for action security_group_rules [ 593.934480] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 46299e31-1097-4753-8f76-35280209d73c with Priority: HIGHEST for action security_group_members [ 593.934843] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1391178e-1c76-4d0a-8b55-f2895525073d with Priority: HIGHEST for action port [ 593.934962] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock rules-46299e31-1097-4753-8f76-35280209d73c taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.935140] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-46299e31-1097-4753-8f76-35280209d73c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.935229] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-46299e31-1097-4753-8f76-35280209d73c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.935554] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-46299e31-1097-4753-8f76-35280209d73c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.935653] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('46299e31-1097-4753-8f76-35280209d73c',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 593.937697] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-46299e31-1097-4753-8f76-35280209d73c taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.937836] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-46299e31-1097-4753-8f76-35280209d73c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.937903] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-46299e31-1097-4753-8f76-35280209d73c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.938109] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-46299e31-1097-4753-8f76-35280209d73c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.938289] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.938385] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.938449] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.938598] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.938674] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.938780] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('46299e31-1097-4753-8f76-35280209d73c',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 593.942103] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock port-1391178e-1c76-4d0a-8b55-f2895525073d taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.942103] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1391178e-1c76-4d0a-8b55-f2895525073d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.942103] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1391178e-1c76-4d0a-8b55-f2895525073d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.942103] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1391178e-1c76-4d0a-8b55-f2895525073d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.942103] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1391178e-1c76-4d0a-8b55-f2895525073d',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 594.352044] env[65306]: INFO networking_nsxv3.common.synchronization [req-67727329-4a05-4498-beb0-84a75700f29f req-c4246810-2b1d-44eb-ba4d-404f55a2af3b tempest-ServersAdminNegativeTestJSON-1507119040 tempest-ServersAdminNegativeTestJSON-1507119040-project-member] Enqueued Resource ID: e3e0f6b2-2984-4938-adcc-0374a714ff76 with Priority: HIGHEST for action security_group_members [ 594.352044] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e3e0f6b2-2984-4938-adcc-0374a714ff76 with Priority: HIGHEST for action security_group_members [ 594.352044] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-e3e0f6b2-2984-4938-adcc-0374a714ff76 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.352044] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e3e0f6b2-2984-4938-adcc-0374a714ff76" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.352044] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e3e0f6b2-2984-4938-adcc-0374a714ff76" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.352044] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e3e0f6b2-2984-4938-adcc-0374a714ff76" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.352581] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.352885] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.352885] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.352983] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.353036] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.353504] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e3e0f6b2-2984-4938-adcc-0374a714ff76',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 594.444009] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-46299e31-1097-4753-8f76-35280209d73c taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.444620] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-46299e31-1097-4753-8f76-35280209d73c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.461147] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('46299e31-1097-4753-8f76-35280209d73c',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 594.461998] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1391178e-1c76-4d0a-8b55-f2895525073d with status ACTIVE [ 594.463082] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.463082] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.463082] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.464996] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.464996] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.465316] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.465526] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.465691] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.466263] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.466263] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.466578] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.466793] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.467024] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.468147] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.468147] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.468147] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1391178e-1c76-4d0a-8b55-f2895525073d is going to be updated. [ 594.491349] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.491542] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.491579] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.491779] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.491913] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.492101] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1391178e-1c76-4d0a-8b55-f2895525073d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.639497] env[65306]: INFO networking_nsxv3.common.synchronization [None req-261f15d8-8c14-416e-b61a-083fbb1e3ded None None] Enqueued Resource ID: 441e7cf2-fff7-4df4-b4b7-8e8a24dfe5ae with Priority: HIGHEST for action port [ 594.640652] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 441e7cf2-fff7-4df4-b4b7-8e8a24dfe5ae with Priority: HIGHEST for action port [ 594.641138] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock port-441e7cf2-fff7-4df4-b4b7-8e8a24dfe5ae taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.641237] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-441e7cf2-fff7-4df4-b4b7-8e8a24dfe5ae" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.641273] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-441e7cf2-fff7-4df4-b4b7-8e8a24dfe5ae" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.641529] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-441e7cf2-fff7-4df4-b4b7-8e8a24dfe5ae" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.642735] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('441e7cf2-fff7-4df4-b4b7-8e8a24dfe5ae',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 594.855418] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.855609] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.855686] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.855946] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.856055] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.856268] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.856374] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.856439] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.856599] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.856689] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.856801] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e3e0f6b2-2984-4938-adcc-0374a714ff76 already deleted. [ 594.856898] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e3e0f6b2-2984-4938-adcc-0374a714ff76" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.922031] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock network-707 taken with stack trace [, , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.922031] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "network-707" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.922031] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "network-707" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.922031] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "network-707" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.922264] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.922414] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.922521] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.922733] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.922918] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.923067] env[65306]: DEBUG dogpile.cache.region [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] No value present for key: 'zone-id' {{(pid=65306) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 594.923178] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] NeedRegenerationException {{(pid=65306) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 594.923455] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] no value, waiting for create lock {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 594.923455] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] value creation lock acquired {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 594.923517] env[65306]: DEBUG dogpile.cache.region [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] No value present for key: 'zone-id' {{(pid=65306) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 594.923575] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Calling creation function for not-yet-present value {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 594.923707] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 594.945750] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 594.945750] env[65306]: DEBUG dogpile.cache.region [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65306) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 594.945750] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Released creation lock {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 594.945750] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "network-707" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.946098] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock port-5d0db364-a5aa-4e9e-8bfd-c3d517e75dad taken with stack trace [, , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.946336] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "port-5d0db364-a5aa-4e9e-8bfd-c3d517e75dad" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.946724] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "port-5d0db364-a5aa-4e9e-8bfd-c3d517e75dad" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.946724] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "port-5d0db364-a5aa-4e9e-8bfd-c3d517e75dad" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.947114] env[65306]: DEBUG networking_nsxv3.api.rpc [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5d0db364-a5aa-4e9e-8bfd-c3d517e75dad',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 594.971282] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('46299e31-1097-4753-8f76-35280209d73c',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 595.144045] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 441e7cf2-fff7-4df4-b4b7-8e8a24dfe5ae [ 595.144045] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.144045] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.144045] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.144045] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.144347] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.144347] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:441e7cf2-fff7-4df4-b4b7-8e8a24dfe5ae already deleted. [ 595.144347] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-441e7cf2-fff7-4df4-b4b7-8e8a24dfe5ae" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.450168] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.450470] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.450620] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.450950] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.453030] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.453030] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Segment Port 5d0db364-a5aa-4e9e-8bfd-c3d517e75dad not found, creating... [ 595.453030] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.453030] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.453030] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.453030] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.453030] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.453030] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.453030] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.454025] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.454513] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.454513] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.454668] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Resource: SegmentPort with ID: 5d0db364-a5aa-4e9e-8bfd-c3d517e75dad is going to be created. [ 595.475510] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.477033] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.477033] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.477033] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.477033] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.477033] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 46299e31-1097-4753-8f76-35280209d73c is going to be created. [ 595.483906] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.484189] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.484374] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.488017] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.488017] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.488017] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "port-5d0db364-a5aa-4e9e-8bfd-c3d517e75dad" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.538354] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.538534] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.538572] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.540019] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.540019] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.560023] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 46299e31-1097-4753-8f76-35280209d73c in Status: UNINITIALIZED for 2s [ 595.625879] env[65306]: INFO networking_nsxv3.common.synchronization [None req-cd68f47f-58f0-4a63-af2f-0d36edccab87 None None] Enqueued Resource ID: 738c5236-9b27-46eb-8221-a94ad5b9721b with Priority: HIGHEST for action port [ 595.626164] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 738c5236-9b27-46eb-8221-a94ad5b9721b with Priority: HIGHEST for action port [ 595.626964] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock port-738c5236-9b27-46eb-8221-a94ad5b9721b taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.627275] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-738c5236-9b27-46eb-8221-a94ad5b9721b" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.627275] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-738c5236-9b27-46eb-8221-a94ad5b9721b" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.627441] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-738c5236-9b27-46eb-8221-a94ad5b9721b" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.627564] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('738c5236-9b27-46eb-8221-a94ad5b9721b',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 596.130409] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 738c5236-9b27-46eb-8221-a94ad5b9721b [ 596.130668] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.130766] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.130829] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.131050] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.131141] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.131234] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:738c5236-9b27-46eb-8221-a94ad5b9721b already deleted. [ 596.131313] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-738c5236-9b27-46eb-8221-a94ad5b9721b" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.193041] env[65306]: INFO networking_nsxv3.common.synchronization [req-67727329-4a05-4498-beb0-84a75700f29f req-549f8479-d21d-419b-8e24-6a0773ba8165 service nova] Enqueued Resource ID: e3e0f6b2-2984-4938-adcc-0374a714ff76 with Priority: HIGHEST for action security_group_rules [ 596.193224] env[65306]: INFO networking_nsxv3.common.synchronization [req-67727329-4a05-4498-beb0-84a75700f29f req-549f8479-d21d-419b-8e24-6a0773ba8165 service nova] Enqueued Resource ID: e3e0f6b2-2984-4938-adcc-0374a714ff76 with Priority: HIGHEST for action security_group_members [ 596.193349] env[65306]: INFO networking_nsxv3.common.synchronization [req-67727329-4a05-4498-beb0-84a75700f29f req-549f8479-d21d-419b-8e24-6a0773ba8165 service nova] Enqueued Resource ID: 5d0db364-a5aa-4e9e-8bfd-c3d517e75dad with Priority: HIGHEST for action port [ 596.193578] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e3e0f6b2-2984-4938-adcc-0374a714ff76 with Priority: HIGHEST for action security_group_rules [ 596.193697] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e3e0f6b2-2984-4938-adcc-0374a714ff76 with Priority: HIGHEST for action security_group_members [ 596.193790] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5d0db364-a5aa-4e9e-8bfd-c3d517e75dad with Priority: HIGHEST for action port [ 596.194376] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e3e0f6b2-2984-4938-adcc-0374a714ff76 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.194496] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e3e0f6b2-2984-4938-adcc-0374a714ff76" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.194562] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e3e0f6b2-2984-4938-adcc-0374a714ff76" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.194818] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e3e0f6b2-2984-4938-adcc-0374a714ff76" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.194897] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e3e0f6b2-2984-4938-adcc-0374a714ff76',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 596.196199] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-e3e0f6b2-2984-4938-adcc-0374a714ff76 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.196347] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e3e0f6b2-2984-4938-adcc-0374a714ff76" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.196415] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e3e0f6b2-2984-4938-adcc-0374a714ff76" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.196600] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e3e0f6b2-2984-4938-adcc-0374a714ff76" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.196747] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.196838] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.196898] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.197050] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.197138] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.197230] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e3e0f6b2-2984-4938-adcc-0374a714ff76',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 596.199594] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock port-5d0db364-a5aa-4e9e-8bfd-c3d517e75dad taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.199765] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5d0db364-a5aa-4e9e-8bfd-c3d517e75dad" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.199991] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5d0db364-a5aa-4e9e-8bfd-c3d517e75dad" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.200051] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5d0db364-a5aa-4e9e-8bfd-c3d517e75dad" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.201521] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5d0db364-a5aa-4e9e-8bfd-c3d517e75dad',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 596.297442] env[65306]: INFO networking_nsxv3.common.synchronization [None req-d75f2652-152d-4862-ab72-88629c8b6749 None None] Enqueued Resource ID: 8c5e2a8a-e61a-45fd-8f10-c8e34528d5ca with Priority: HIGHEST for action port [ 596.297442] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8c5e2a8a-e61a-45fd-8f10-c8e34528d5ca with Priority: HIGHEST for action port [ 596.297442] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock port-8c5e2a8a-e61a-45fd-8f10-c8e34528d5ca taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.297442] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8c5e2a8a-e61a-45fd-8f10-c8e34528d5ca" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.297442] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8c5e2a8a-e61a-45fd-8f10-c8e34528d5ca" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.297768] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8c5e2a8a-e61a-45fd-8f10-c8e34528d5ca" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.297768] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8c5e2a8a-e61a-45fd-8f10-c8e34528d5ca',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 596.700741] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e3e0f6b2-2984-4938-adcc-0374a714ff76',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 596.701811] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-e3e0f6b2-2984-4938-adcc-0374a714ff76 taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.701919] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e3e0f6b2-2984-4938-adcc-0374a714ff76" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.702687] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5d0db364-a5aa-4e9e-8bfd-c3d517e75dad with status ACTIVE [ 596.702687] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.702687] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.702687] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.702921] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.702921] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.703538] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.703538] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.703538] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.703538] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.703538] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.703761] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.703761] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.703761] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.704409] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.704409] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.704409] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5d0db364-a5aa-4e9e-8bfd-c3d517e75dad is going to be updated. [ 596.728259] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.728259] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.728259] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.728519] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.728519] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.728678] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5d0db364-a5aa-4e9e-8bfd-c3d517e75dad" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.756578] env[65306]: INFO networking_nsxv3.common.synchronization [req-0890bd06-2b46-45ef-915d-90ab5ac07bf6 req-b4d60713-42bc-405a-bff7-89b34fd245dd tempest-DeleteServersAdminTestJSON-721532732 tempest-DeleteServersAdminTestJSON-721532732-project-member] Enqueued Resource ID: 70b8bb37-9445-4339-82b5-ebb24bd0be78 with Priority: HIGHEST for action security_group_members [ 596.756578] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 70b8bb37-9445-4339-82b5-ebb24bd0be78 with Priority: HIGHEST for action security_group_members [ 596.756578] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-70b8bb37-9445-4339-82b5-ebb24bd0be78 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.756578] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-70b8bb37-9445-4339-82b5-ebb24bd0be78" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.756578] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-70b8bb37-9445-4339-82b5-ebb24bd0be78" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.756797] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-70b8bb37-9445-4339-82b5-ebb24bd0be78" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.756826] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.756914] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.756975] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.757143] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.757230] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.757324] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('70b8bb37-9445-4339-82b5-ebb24bd0be78',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 596.800602] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8c5e2a8a-e61a-45fd-8f10-c8e34528d5ca [ 596.800602] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.800602] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.800602] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.800897] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.800932] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.801178] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8c5e2a8a-e61a-45fd-8f10-c8e34528d5ca already deleted. [ 596.801243] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8c5e2a8a-e61a-45fd-8f10-c8e34528d5ca" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.202943] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e3e0f6b2-2984-4938-adcc-0374a714ff76',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 597.274282] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.274282] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.274282] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.274282] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.274282] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.274282] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.274282] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.274282] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.274282] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.274282] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.274282] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 70b8bb37-9445-4339-82b5-ebb24bd0be78 already deleted. [ 597.274282] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-70b8bb37-9445-4339-82b5-ebb24bd0be78" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.314235] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock network-707 taken with stack trace [, , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.314235] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "network-707" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.314235] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "network-707" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.314235] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "network-707" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.314235] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.314704] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.314704] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.314704] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.316613] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.316613] env[65306]: DEBUG dogpile.cache.region [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] No value present for key: 'zone-id' {{(pid=65306) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 597.316613] env[65306]: DEBUG dogpile.lock [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] NeedRegenerationException {{(pid=65306) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 597.316613] env[65306]: DEBUG dogpile.lock [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] no value, waiting for create lock {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 597.316613] env[65306]: DEBUG dogpile.lock [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] value creation lock acquired {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 597.316613] env[65306]: DEBUG dogpile.cache.region [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] No value present for key: 'zone-id' {{(pid=65306) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 597.316613] env[65306]: DEBUG dogpile.lock [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Calling creation function for not-yet-present value {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 597.316613] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 597.348280] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 597.349024] env[65306]: DEBUG dogpile.cache.region [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Cache value generated in 0.033 seconds for key(s): 'zone-id' {{(pid=65306) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 597.349024] env[65306]: DEBUG dogpile.lock [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Released creation lock {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 597.349024] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "network-707" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.349247] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock port-0939c9a6-35fb-4453-ab08-cc2fd1abc69f taken with stack trace [, , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.349247] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "port-0939c9a6-35fb-4453-ab08-cc2fd1abc69f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.349364] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "port-0939c9a6-35fb-4453-ab08-cc2fd1abc69f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.349786] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "port-0939c9a6-35fb-4453-ab08-cc2fd1abc69f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.349920] env[65306]: DEBUG networking_nsxv3.api.rpc [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0939c9a6-35fb-4453-ab08-cc2fd1abc69f',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 597.566493] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 46299e31-1097-4753-8f76-35280209d73c in Status: SUCCESS [ 597.566724] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-46299e31-1097-4753-8f76-35280209d73c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.566887] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-46299e31-1097-4753-8f76-35280209d73c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.567133] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-46299e31-1097-4753-8f76-35280209d73c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.567328] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.567447] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.567513] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.567667] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.567749] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.567833] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-46299e31-1097-4753-8f76-35280209d73c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.567928] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('46299e31-1097-4753-8f76-35280209d73c',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 597.706285] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.706285] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.706285] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.706285] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.706285] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.706285] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e3e0f6b2-2984-4938-adcc-0374a714ff76 is going to be created. [ 597.730900] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.731177] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.731312] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.731605] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.732075] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.744031] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e3e0f6b2-2984-4938-adcc-0374a714ff76 in Status: UNINITIALIZED for 2s [ 597.852629] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.852862] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.852983] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.853387] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.853559] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.853735] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Segment Port 0939c9a6-35fb-4453-ab08-cc2fd1abc69f not found, creating... [ 597.854043] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.854251] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.854394] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.854642] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.854808] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.855118] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.855334] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.855412] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.855618] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.855749] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.855915] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Resource: SegmentPort with ID: 0939c9a6-35fb-4453-ab08-cc2fd1abc69f is going to be created. [ 597.877890] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.878150] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.878288] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.878695] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.878945] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.879240] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "port-0939c9a6-35fb-4453-ab08-cc2fd1abc69f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.072036] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-46299e31-1097-4753-8f76-35280209d73c taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.072036] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-46299e31-1097-4753-8f76-35280209d73c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.072036] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-46299e31-1097-4753-8f76-35280209d73c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.072036] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-46299e31-1097-4753-8f76-35280209d73c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.072036] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.072036] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.072036] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.072036] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.072036] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.072036] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-46299e31-1097-4753-8f76-35280209d73c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.072535] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-46299e31-1097-4753-8f76-35280209d73c taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.072535] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-46299e31-1097-4753-8f76-35280209d73c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.072535] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-46299e31-1097-4753-8f76-35280209d73c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.072535] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-46299e31-1097-4753-8f76-35280209d73c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.072664] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.072664] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.072732] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.073982] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.073982] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.073982] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-46299e31-1097-4753-8f76-35280209d73c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.073982] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('46299e31-1097-4753-8f76-35280209d73c',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 598.576064] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 46299e31-1097-4753-8f76-35280209d73c: rpc.has_security_group_logging(os_id): False [ 598.596312] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.596312] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.596312] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.596312] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.596312] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.596312] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.596312] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.596312] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.597543] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.597543] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.601677] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.601677] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.601677] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.601677] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.601677] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.601677] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.601677] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.601677] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.601677] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.601677] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.601677] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 46299e31-1097-4753-8f76-35280209d73c is going to be created. [ 598.664401] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.664574] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.664574] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.664749] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.664924] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.677208] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 46299e31-1097-4753-8f76-35280209d73c in Status: IN_PROGRESS for 2s [ 598.745867] env[65306]: INFO networking_nsxv3.common.synchronization [req-0890bd06-2b46-45ef-915d-90ab5ac07bf6 req-cba4fe98-97fe-43f7-b0c9-3fd658c03799 service nova] Enqueued Resource ID: 70b8bb37-9445-4339-82b5-ebb24bd0be78 with Priority: HIGHEST for action security_group_rules [ 598.746232] env[65306]: INFO networking_nsxv3.common.synchronization [req-0890bd06-2b46-45ef-915d-90ab5ac07bf6 req-cba4fe98-97fe-43f7-b0c9-3fd658c03799 service nova] Enqueued Resource ID: 70b8bb37-9445-4339-82b5-ebb24bd0be78 with Priority: HIGHEST for action security_group_members [ 598.746232] env[65306]: INFO networking_nsxv3.common.synchronization [req-0890bd06-2b46-45ef-915d-90ab5ac07bf6 req-cba4fe98-97fe-43f7-b0c9-3fd658c03799 service nova] Enqueued Resource ID: 0939c9a6-35fb-4453-ab08-cc2fd1abc69f with Priority: HIGHEST for action port [ 598.747499] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 70b8bb37-9445-4339-82b5-ebb24bd0be78 with Priority: HIGHEST for action security_group_rules [ 598.747499] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 70b8bb37-9445-4339-82b5-ebb24bd0be78 with Priority: HIGHEST for action security_group_members [ 598.747499] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0939c9a6-35fb-4453-ab08-cc2fd1abc69f with Priority: HIGHEST for action port [ 598.747499] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock rules-70b8bb37-9445-4339-82b5-ebb24bd0be78 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.747499] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-70b8bb37-9445-4339-82b5-ebb24bd0be78" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.747777] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-70b8bb37-9445-4339-82b5-ebb24bd0be78" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.747848] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-70b8bb37-9445-4339-82b5-ebb24bd0be78" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.747888] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('70b8bb37-9445-4339-82b5-ebb24bd0be78',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 598.748999] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-70b8bb37-9445-4339-82b5-ebb24bd0be78 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.748999] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-70b8bb37-9445-4339-82b5-ebb24bd0be78" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.749190] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-70b8bb37-9445-4339-82b5-ebb24bd0be78" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.749388] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-70b8bb37-9445-4339-82b5-ebb24bd0be78" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.749449] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.749536] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.749595] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.749829] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.749829] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.749997] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('70b8bb37-9445-4339-82b5-ebb24bd0be78',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 598.751228] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock port-0939c9a6-35fb-4453-ab08-cc2fd1abc69f taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.751420] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0939c9a6-35fb-4453-ab08-cc2fd1abc69f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.751818] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0939c9a6-35fb-4453-ab08-cc2fd1abc69f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.752012] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0939c9a6-35fb-4453-ab08-cc2fd1abc69f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.752119] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0939c9a6-35fb-4453-ab08-cc2fd1abc69f',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 598.875712] env[65306]: INFO networking_nsxv3.common.synchronization [None req-3ca1e032-720d-4c43-b715-538a59689cf5 None None] Enqueued Resource ID: cbfef542-7e26-4fc0-812c-9bbab291cf28 with Priority: HIGHEST for action port [ 598.877414] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cbfef542-7e26-4fc0-812c-9bbab291cf28 with Priority: HIGHEST for action port [ 598.877414] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock port-cbfef542-7e26-4fc0-812c-9bbab291cf28 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.878176] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cbfef542-7e26-4fc0-812c-9bbab291cf28" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.878176] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cbfef542-7e26-4fc0-812c-9bbab291cf28" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.878404] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cbfef542-7e26-4fc0-812c-9bbab291cf28" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.878458] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cbfef542-7e26-4fc0-812c-9bbab291cf28',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 598.914712] env[65306]: INFO networking_nsxv3.common.synchronization [None req-ba5bba25-9449-4c75-afd1-b5e6183e1d77 None None] Enqueued Resource ID: 1404fa1e-36f0-426c-9c38-6383f5f1923a with Priority: HIGHEST for action port [ 598.917640] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1404fa1e-36f0-426c-9c38-6383f5f1923a with Priority: HIGHEST for action port [ 598.917943] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock port-1404fa1e-36f0-426c-9c38-6383f5f1923a taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.918089] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1404fa1e-36f0-426c-9c38-6383f5f1923a" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.918228] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1404fa1e-36f0-426c-9c38-6383f5f1923a" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.918564] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1404fa1e-36f0-426c-9c38-6383f5f1923a" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.918722] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1404fa1e-36f0-426c-9c38-6383f5f1923a',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 599.169603] env[65306]: INFO networking_nsxv3.common.synchronization [req-513a9f9d-bcc0-453c-9f5c-36ec3a567370 req-c0c639fd-fabf-461a-8c80-18e8aa95f8f3 tempest-MultipleCreateTestJSON-2038963662 tempest-MultipleCreateTestJSON-2038963662-project-member] Enqueued Resource ID: df9d38aa-4663-42d9-8451-f5b81969567d with Priority: HIGHEST for action security_group_members [ 599.169896] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: df9d38aa-4663-42d9-8451-f5b81969567d with Priority: HIGHEST for action security_group_members [ 599.171623] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-df9d38aa-4663-42d9-8451-f5b81969567d taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.172530] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-df9d38aa-4663-42d9-8451-f5b81969567d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.172530] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-df9d38aa-4663-42d9-8451-f5b81969567d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.172530] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-df9d38aa-4663-42d9-8451-f5b81969567d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.172530] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.172530] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.172530] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.172784] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.172832] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.172924] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('df9d38aa-4663-42d9-8451-f5b81969567d',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 599.254359] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-70b8bb37-9445-4339-82b5-ebb24bd0be78 taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.254576] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-70b8bb37-9445-4339-82b5-ebb24bd0be78" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.254850] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('70b8bb37-9445-4339-82b5-ebb24bd0be78',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 599.257747] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0939c9a6-35fb-4453-ab08-cc2fd1abc69f with status ACTIVE [ 599.257747] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.257747] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.257747] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.258100] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.258100] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.258336] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.258460] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.258526] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.258694] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.258949] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.259050] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.259115] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.259181] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.259377] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.259574] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.259574] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0939c9a6-35fb-4453-ab08-cc2fd1abc69f is going to be updated. [ 599.288515] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.288778] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.288778] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.289048] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.289213] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.289382] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0939c9a6-35fb-4453-ab08-cc2fd1abc69f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.327160] env[65306]: INFO networking_nsxv3.common.synchronization [None req-92558d03-fa22-4bbf-acbf-a793e8b62b3c tempest-VolumesAssistedSnapshotsTest-47459573 tempest-VolumesAssistedSnapshotsTest-47459573-project-member] Enqueued Resource ID: 5ec09b70-aa5a-48ff-b72f-a5c6c81190e0 with Priority: HIGHEST for action security_group_rules [ 599.327160] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5ec09b70-aa5a-48ff-b72f-a5c6c81190e0 with Priority: HIGHEST for action security_group_rules [ 599.327160] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5ec09b70-aa5a-48ff-b72f-a5c6c81190e0 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.327160] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5ec09b70-aa5a-48ff-b72f-a5c6c81190e0" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.327160] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5ec09b70-aa5a-48ff-b72f-a5c6c81190e0" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.327160] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5ec09b70-aa5a-48ff-b72f-a5c6c81190e0" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.327160] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5ec09b70-aa5a-48ff-b72f-a5c6c81190e0',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 599.381868] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port cbfef542-7e26-4fc0-812c-9bbab291cf28 [ 599.383258] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.383258] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.383258] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.383258] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.383258] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.383258] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:cbfef542-7e26-4fc0-812c-9bbab291cf28 already deleted. [ 599.383258] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cbfef542-7e26-4fc0-812c-9bbab291cf28" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.422716] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1404fa1e-36f0-426c-9c38-6383f5f1923a [ 599.423214] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.423382] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.423468] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.423734] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.423825] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.423925] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1404fa1e-36f0-426c-9c38-6383f5f1923a already deleted. [ 599.424168] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1404fa1e-36f0-426c-9c38-6383f5f1923a" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.493269] env[65306]: INFO networking_nsxv3.common.synchronization [None req-7bdf0752-5239-4389-9dca-28ab7e6b306e None None] Enqueued Resource ID: c9899e9b-e674-4e79-a2eb-1df2ae78ba0d with Priority: HIGHEST for action port [ 599.493523] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c9899e9b-e674-4e79-a2eb-1df2ae78ba0d with Priority: HIGHEST for action port [ 599.494091] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock port-c9899e9b-e674-4e79-a2eb-1df2ae78ba0d taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.494217] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c9899e9b-e674-4e79-a2eb-1df2ae78ba0d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.494437] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c9899e9b-e674-4e79-a2eb-1df2ae78ba0d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.494531] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c9899e9b-e674-4e79-a2eb-1df2ae78ba0d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.494610] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c9899e9b-e674-4e79-a2eb-1df2ae78ba0d',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 599.675156] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.675252] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.675252] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.675487] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.675564] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.675724] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.675827] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.675884] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.676434] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.676434] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.676434] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: df9d38aa-4663-42d9-8451-f5b81969567d already deleted. [ 599.676434] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-df9d38aa-4663-42d9-8451-f5b81969567d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.733085] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock network-561 taken with stack trace [, , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.733998] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "network-561" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.733998] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "network-561" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.733998] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "network-561" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.734302] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.734517] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.734680] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.734942] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.735150] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.735399] env[65306]: DEBUG dogpile.cache.region [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] No value present for key: 'zone-id' {{(pid=65306) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 599.735572] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] NeedRegenerationException {{(pid=65306) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 599.735725] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] no value, waiting for create lock {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 599.735875] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] value creation lock acquired {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 599.736036] env[65306]: DEBUG dogpile.cache.region [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] No value present for key: 'zone-id' {{(pid=65306) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 599.736193] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Calling creation function for not-yet-present value {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 599.736394] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 599.757100] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 599.757429] env[65306]: DEBUG dogpile.cache.region [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65306) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 599.757429] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Released creation lock {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 599.757573] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "network-561" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.757890] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock port-a13626ab-dd5e-47a4-a527-e37557e71032 taken with stack trace [, , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.758095] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "port-a13626ab-dd5e-47a4-a527-e37557e71032" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.758201] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "port-a13626ab-dd5e-47a4-a527-e37557e71032" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.758530] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "port-a13626ab-dd5e-47a4-a527-e37557e71032" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.758901] env[65306]: DEBUG networking_nsxv3.api.rpc [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a13626ab-dd5e-47a4-a527-e37557e71032',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 599.760216] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('70b8bb37-9445-4339-82b5-ebb24bd0be78',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 599.763565] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e3e0f6b2-2984-4938-adcc-0374a714ff76 in Status: SUCCESS [ 599.763756] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e3e0f6b2-2984-4938-adcc-0374a714ff76" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.763908] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e3e0f6b2-2984-4938-adcc-0374a714ff76" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.764114] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e3e0f6b2-2984-4938-adcc-0374a714ff76" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.764301] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.764440] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.764510] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.764671] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.764753] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.764837] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e3e0f6b2-2984-4938-adcc-0374a714ff76" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.764914] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e3e0f6b2-2984-4938-adcc-0374a714ff76',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 599.855511] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.856992] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.856992] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.858164] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.858356] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.858914] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5ec09b70-aa5a-48ff-b72f-a5c6c81190e0 already deleted. [ 599.858914] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5ec09b70-aa5a-48ff-b72f-a5c6c81190e0" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.891553] env[65306]: INFO networking_nsxv3.common.synchronization [None req-c34f7e14-608e-4407-95d0-6e78dd04a4f7 tempest-VolumesAssistedSnapshotsTest-47459573 tempest-VolumesAssistedSnapshotsTest-47459573-project-member] Enqueued Resource ID: 5ec09b70-aa5a-48ff-b72f-a5c6c81190e0 with Priority: HIGHEST for action security_group_rules [ 599.891871] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5ec09b70-aa5a-48ff-b72f-a5c6c81190e0 with Priority: HIGHEST for action security_group_rules [ 599.891949] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5ec09b70-aa5a-48ff-b72f-a5c6c81190e0 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.892076] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5ec09b70-aa5a-48ff-b72f-a5c6c81190e0" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.892165] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5ec09b70-aa5a-48ff-b72f-a5c6c81190e0" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.892347] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5ec09b70-aa5a-48ff-b72f-a5c6c81190e0" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.892447] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5ec09b70-aa5a-48ff-b72f-a5c6c81190e0',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 600.000162] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c9899e9b-e674-4e79-a2eb-1df2ae78ba0d [ 600.001065] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.001065] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.001065] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.001065] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.001065] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.001065] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c9899e9b-e674-4e79-a2eb-1df2ae78ba0d already deleted. [ 600.001065] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c9899e9b-e674-4e79-a2eb-1df2ae78ba0d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.101185] env[65306]: INFO networking_nsxv3.common.synchronization [None req-f5a3fe77-2f52-468b-af7f-c21287296bcf None None] Enqueued Resource ID: 8a3796c2-6d0a-4d42-a322-d8121749e22e with Priority: HIGHEST for action port [ 600.101185] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8a3796c2-6d0a-4d42-a322-d8121749e22e with Priority: HIGHEST for action port [ 600.101386] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock port-8a3796c2-6d0a-4d42-a322-d8121749e22e taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.101501] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8a3796c2-6d0a-4d42-a322-d8121749e22e" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.101560] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8a3796c2-6d0a-4d42-a322-d8121749e22e" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.101811] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8a3796c2-6d0a-4d42-a322-d8121749e22e" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.101934] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8a3796c2-6d0a-4d42-a322-d8121749e22e',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 600.262524] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.262745] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.262853] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.263151] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.263298] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.263524] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Segment Port a13626ab-dd5e-47a4-a527-e37557e71032 not found, creating... [ 600.263926] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.264181] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.264361] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.264680] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.264878] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.265316] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.265561] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.265743] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.266014] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.266235] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.266432] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Resource: SegmentPort with ID: a13626ab-dd5e-47a4-a527-e37557e71032 is going to be created. [ 600.267911] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-e3e0f6b2-2984-4938-adcc-0374a714ff76 taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.267911] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e3e0f6b2-2984-4938-adcc-0374a714ff76" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.267911] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e3e0f6b2-2984-4938-adcc-0374a714ff76" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.267911] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e3e0f6b2-2984-4938-adcc-0374a714ff76" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.268132] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.268177] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.268212] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.268427] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.268505] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.268588] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e3e0f6b2-2984-4938-adcc-0374a714ff76" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.268735] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-e3e0f6b2-2984-4938-adcc-0374a714ff76 taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.268828] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e3e0f6b2-2984-4938-adcc-0374a714ff76" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.268888] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e3e0f6b2-2984-4938-adcc-0374a714ff76" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.269039] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e3e0f6b2-2984-4938-adcc-0374a714ff76" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.269179] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.269272] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.269337] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.269496] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.269571] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.269649] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e3e0f6b2-2984-4938-adcc-0374a714ff76" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.269740] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e3e0f6b2-2984-4938-adcc-0374a714ff76',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 600.270766] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.270852] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.270852] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.271014] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.271104] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.271193] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 70b8bb37-9445-4339-82b5-ebb24bd0be78 is going to be created. [ 600.289983] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.290302] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.290478] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.290782] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.291072] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.291344] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "port-a13626ab-dd5e-47a4-a527-e37557e71032" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.293826] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.293948] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.294021] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.294358] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.294358] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.304428] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 70b8bb37-9445-4339-82b5-ebb24bd0be78 in Status: UNINITIALIZED for 2s [ 600.423347] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.423519] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.423519] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.423762] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.423873] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.423991] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5ec09b70-aa5a-48ff-b72f-a5c6c81190e0 already deleted. [ 600.424112] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5ec09b70-aa5a-48ff-b72f-a5c6c81190e0" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.604357] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8a3796c2-6d0a-4d42-a322-d8121749e22e [ 600.604628] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.604783] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.604867] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.605139] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.605477] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.605477] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8a3796c2-6d0a-4d42-a322-d8121749e22e already deleted. [ 600.605477] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8a3796c2-6d0a-4d42-a322-d8121749e22e" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.689373] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 46299e31-1097-4753-8f76-35280209d73c in Status: SUCCESS [ 600.689778] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-46299e31-1097-4753-8f76-35280209d73c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.773207] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e3e0f6b2-2984-4938-adcc-0374a714ff76: rpc.has_security_group_logging(os_id): False [ 600.790451] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.790636] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.790700] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.790916] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.791017] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.791246] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.791399] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.791399] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.791558] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.791639] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.791821] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.791923] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.791972] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.792126] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.792364] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.793175] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.793175] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.793175] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.793175] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.793175] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.793175] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e3e0f6b2-2984-4938-adcc-0374a714ff76 is going to be created. [ 600.843553] env[65306]: INFO networking_nsxv3.common.synchronization [req-513a9f9d-bcc0-453c-9f5c-36ec3a567370 req-bad50587-6dd3-4409-8d28-becffbfb8e85 tempest-MultipleCreateTestJSON-2038963662 tempest-MultipleCreateTestJSON-2038963662-project-member] Enqueued Resource ID: df9d38aa-4663-42d9-8451-f5b81969567d with Priority: HIGHEST for action security_group_members [ 600.844163] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: df9d38aa-4663-42d9-8451-f5b81969567d with Priority: HIGHEST for action security_group_members [ 600.844562] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-df9d38aa-4663-42d9-8451-f5b81969567d taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.844641] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-df9d38aa-4663-42d9-8451-f5b81969567d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.844704] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-df9d38aa-4663-42d9-8451-f5b81969567d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.844938] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-df9d38aa-4663-42d9-8451-f5b81969567d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.845202] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.845293] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.845293] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.845527] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.845603] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.845655] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('df9d38aa-4663-42d9-8451-f5b81969567d',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 600.852438] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.852438] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.852438] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.852438] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.852713] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.872146] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e3e0f6b2-2984-4938-adcc-0374a714ff76 in Status: IN_PROGRESS for 2s [ 601.095838] env[65306]: INFO networking_nsxv3.common.synchronization [req-513a9f9d-bcc0-453c-9f5c-36ec3a567370 req-e49d1710-357b-44ea-a6a7-41728854c3dd service nova] Enqueued Resource ID: df9d38aa-4663-42d9-8451-f5b81969567d with Priority: HIGHEST for action security_group_rules [ 601.096045] env[65306]: INFO networking_nsxv3.common.synchronization [req-513a9f9d-bcc0-453c-9f5c-36ec3a567370 req-e49d1710-357b-44ea-a6a7-41728854c3dd service nova] Enqueued Resource ID: df9d38aa-4663-42d9-8451-f5b81969567d with Priority: HIGHEST for action security_group_members [ 601.096193] env[65306]: INFO networking_nsxv3.common.synchronization [req-513a9f9d-bcc0-453c-9f5c-36ec3a567370 req-e49d1710-357b-44ea-a6a7-41728854c3dd service nova] Enqueued Resource ID: a13626ab-dd5e-47a4-a527-e37557e71032 with Priority: HIGHEST for action port [ 601.096804] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: df9d38aa-4663-42d9-8451-f5b81969567d with Priority: HIGHEST for action security_group_rules [ 601.096928] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: df9d38aa-4663-42d9-8451-f5b81969567d with Priority: HIGHEST for action security_group_members [ 601.097039] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a13626ab-dd5e-47a4-a527-e37557e71032 with Priority: HIGHEST for action port [ 601.097327] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock rules-df9d38aa-4663-42d9-8451-f5b81969567d taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.097451] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-df9d38aa-4663-42d9-8451-f5b81969567d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.097513] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-df9d38aa-4663-42d9-8451-f5b81969567d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.097762] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-df9d38aa-4663-42d9-8451-f5b81969567d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.097842] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('df9d38aa-4663-42d9-8451-f5b81969567d',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 601.099641] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-df9d38aa-4663-42d9-8451-f5b81969567d taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.099952] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-df9d38aa-4663-42d9-8451-f5b81969567d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.100207] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock port-a13626ab-dd5e-47a4-a527-e37557e71032 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.100467] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a13626ab-dd5e-47a4-a527-e37557e71032" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.100467] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a13626ab-dd5e-47a4-a527-e37557e71032" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.100934] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a13626ab-dd5e-47a4-a527-e37557e71032" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.101018] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a13626ab-dd5e-47a4-a527-e37557e71032',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 601.348228] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('df9d38aa-4663-42d9-8451-f5b81969567d',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 601.405020] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock network-561 taken with stack trace [, , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.405020] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "network-561" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.405020] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "network-561" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.409018] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "network-561" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.409018] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.409018] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.409018] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.409018] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.409018] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.409018] env[65306]: DEBUG dogpile.cache.region [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] No value present for key: 'zone-id' {{(pid=65306) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 601.409018] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] NeedRegenerationException {{(pid=65306) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 601.409018] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] no value, waiting for create lock {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 601.409018] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] value creation lock acquired {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 601.409018] env[65306]: DEBUG dogpile.cache.region [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] No value present for key: 'zone-id' {{(pid=65306) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 601.409018] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Calling creation function for not-yet-present value {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 601.409018] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 601.433036] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 601.433036] env[65306]: DEBUG dogpile.cache.region [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=65306) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 601.433036] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Released creation lock {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 601.433229] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "network-561" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.433418] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock port-979debb6-884b-4873-b63c-4d693567f371 taken with stack trace [, , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.433625] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "port-979debb6-884b-4873-b63c-4d693567f371" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.433756] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "port-979debb6-884b-4873-b63c-4d693567f371" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.434135] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "port-979debb6-884b-4873-b63c-4d693567f371" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.434275] env[65306]: DEBUG networking_nsxv3.api.rpc [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('979debb6-884b-4873-b63c-4d693567f371',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 601.603654] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-df9d38aa-4663-42d9-8451-f5b81969567d taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.603654] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-df9d38aa-4663-42d9-8451-f5b81969567d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.603850] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a13626ab-dd5e-47a4-a527-e37557e71032 with status ACTIVE [ 601.604094] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.604257] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.604327] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.604665] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.604665] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.604796] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.604849] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.604912] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.605078] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.605218] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.605324] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.605412] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.605470] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.605606] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.605682] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.605766] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a13626ab-dd5e-47a4-a527-e37557e71032 is going to be updated. [ 601.636711] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.636711] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.636711] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.636711] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.636711] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.636711] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a13626ab-dd5e-47a4-a527-e37557e71032" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.753539] env[65306]: INFO networking_nsxv3.common.synchronization [None req-247188e6-f5e7-4a4d-9d3f-1c58865ffa3e None None] Enqueued Resource ID: c164a38f-1bd5-4835-bb1a-de4396584d01 with Priority: HIGHEST for action port [ 601.753761] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c164a38f-1bd5-4835-bb1a-de4396584d01 with Priority: HIGHEST for action port [ 601.754301] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock port-c164a38f-1bd5-4835-bb1a-de4396584d01 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.754747] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c164a38f-1bd5-4835-bb1a-de4396584d01" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.755019] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c164a38f-1bd5-4835-bb1a-de4396584d01" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.755630] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c164a38f-1bd5-4835-bb1a-de4396584d01" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.755630] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c164a38f-1bd5-4835-bb1a-de4396584d01',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 601.851195] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('df9d38aa-4663-42d9-8451-f5b81969567d',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 601.937143] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.937439] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.937615] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.937955] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.938251] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.938345] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Segment Port 979debb6-884b-4873-b63c-4d693567f371 not found, creating... [ 601.938651] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.938817] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.938929] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.939229] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.939375] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.939751] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.939940] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.940198] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.940549] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.940753] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.941665] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Resource: SegmentPort with ID: 979debb6-884b-4873-b63c-4d693567f371 is going to be created. [ 601.996343] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.996831] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.997070] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.997542] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.998013] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.998339] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "port-979debb6-884b-4873-b63c-4d693567f371" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.259013] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c164a38f-1bd5-4835-bb1a-de4396584d01 [ 602.259220] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.259448] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.259527] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.259742] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.259828] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.260379] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c164a38f-1bd5-4835-bb1a-de4396584d01 already deleted. [ 602.260379] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c164a38f-1bd5-4835-bb1a-de4396584d01" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.318074] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 70b8bb37-9445-4339-82b5-ebb24bd0be78 in Status: SUCCESS [ 602.318074] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-70b8bb37-9445-4339-82b5-ebb24bd0be78" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.318074] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-70b8bb37-9445-4339-82b5-ebb24bd0be78" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.318074] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-70b8bb37-9445-4339-82b5-ebb24bd0be78" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.318074] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.318074] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.318074] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.318074] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.318074] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.318074] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-70b8bb37-9445-4339-82b5-ebb24bd0be78" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.318074] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('70b8bb37-9445-4339-82b5-ebb24bd0be78',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 602.357560] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.357724] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.357796] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.358017] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.358118] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.358352] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: df9d38aa-4663-42d9-8451-f5b81969567d is going to be created. [ 602.382841] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.383131] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.383232] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.383423] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.383618] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.395890] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: df9d38aa-4663-42d9-8451-f5b81969567d in Status: UNINITIALIZED for 2s [ 602.676312] env[65306]: INFO networking_nsxv3.common.synchronization [req-513a9f9d-bcc0-453c-9f5c-36ec3a567370 req-01ceca6e-23a2-4639-8765-d5a95840e651 service nova] Enqueued Resource ID: df9d38aa-4663-42d9-8451-f5b81969567d with Priority: HIGHEST for action security_group_rules [ 602.676312] env[65306]: INFO networking_nsxv3.common.synchronization [req-513a9f9d-bcc0-453c-9f5c-36ec3a567370 req-01ceca6e-23a2-4639-8765-d5a95840e651 service nova] Enqueued Resource ID: df9d38aa-4663-42d9-8451-f5b81969567d with Priority: HIGHEST for action security_group_members [ 602.676312] env[65306]: INFO networking_nsxv3.common.synchronization [req-513a9f9d-bcc0-453c-9f5c-36ec3a567370 req-01ceca6e-23a2-4639-8765-d5a95840e651 service nova] Enqueued Resource ID: 979debb6-884b-4873-b63c-4d693567f371 with Priority: HIGHEST for action port [ 602.676312] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: df9d38aa-4663-42d9-8451-f5b81969567d with Priority: HIGHEST for action security_group_rules [ 602.676312] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: df9d38aa-4663-42d9-8451-f5b81969567d with Priority: HIGHEST for action security_group_members [ 602.676312] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 979debb6-884b-4873-b63c-4d693567f371 with Priority: HIGHEST for action port [ 602.676312] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock rules-df9d38aa-4663-42d9-8451-f5b81969567d taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.676312] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-df9d38aa-4663-42d9-8451-f5b81969567d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.676312] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-df9d38aa-4663-42d9-8451-f5b81969567d taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.676312] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-df9d38aa-4663-42d9-8451-f5b81969567d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.676312] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock port-979debb6-884b-4873-b63c-4d693567f371 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.676312] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-979debb6-884b-4873-b63c-4d693567f371" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.676312] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-979debb6-884b-4873-b63c-4d693567f371" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.676312] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-979debb6-884b-4873-b63c-4d693567f371" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.676312] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('979debb6-884b-4873-b63c-4d693567f371',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 602.800025] env[65306]: INFO networking_nsxv3.common.synchronization [None req-882fee9a-6b6d-4213-90ab-ebc8bf0e46bd None None] Enqueued Resource ID: 861b72f3-5b3b-4f59-b255-ce5d00e42f50 with Priority: HIGHEST for action port [ 602.800025] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 861b72f3-5b3b-4f59-b255-ce5d00e42f50 with Priority: HIGHEST for action port [ 602.801163] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock port-861b72f3-5b3b-4f59-b255-ce5d00e42f50 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.801348] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-861b72f3-5b3b-4f59-b255-ce5d00e42f50" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.801443] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-861b72f3-5b3b-4f59-b255-ce5d00e42f50" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.801783] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-861b72f3-5b3b-4f59-b255-ce5d00e42f50" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.801921] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('861b72f3-5b3b-4f59-b255-ce5d00e42f50',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 602.821277] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-70b8bb37-9445-4339-82b5-ebb24bd0be78 taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.821277] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-70b8bb37-9445-4339-82b5-ebb24bd0be78" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.821277] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-70b8bb37-9445-4339-82b5-ebb24bd0be78" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.822630] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-70b8bb37-9445-4339-82b5-ebb24bd0be78" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.822630] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.822630] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.822630] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.822630] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.822630] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.822630] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-70b8bb37-9445-4339-82b5-ebb24bd0be78" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.822630] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-70b8bb37-9445-4339-82b5-ebb24bd0be78 taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.822630] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-70b8bb37-9445-4339-82b5-ebb24bd0be78" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.823108] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-70b8bb37-9445-4339-82b5-ebb24bd0be78" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.823108] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-70b8bb37-9445-4339-82b5-ebb24bd0be78" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.823108] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.823108] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.823108] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.823329] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.823329] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.823394] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-70b8bb37-9445-4339-82b5-ebb24bd0be78" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.823478] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('70b8bb37-9445-4339-82b5-ebb24bd0be78',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 602.842070] env[65306]: INFO networking_nsxv3.common.synchronization [None req-58f38353-9794-435a-9ef2-5c7db5013053 tempest-ServerActionsTestOtherB-1027609472 tempest-ServerActionsTestOtherB-1027609472-project-member] Enqueued Resource ID: 37349b8b-c2c1-4141-8b10-752c27492cbd with Priority: HIGHEST for action security_group_rules [ 602.843241] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 37349b8b-c2c1-4141-8b10-752c27492cbd with Priority: HIGHEST for action security_group_rules [ 602.843241] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock rules-37349b8b-c2c1-4141-8b10-752c27492cbd taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.843241] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-37349b8b-c2c1-4141-8b10-752c27492cbd" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.843616] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-37349b8b-c2c1-4141-8b10-752c27492cbd" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.843616] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-37349b8b-c2c1-4141-8b10-752c27492cbd" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.843676] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('37349b8b-c2c1-4141-8b10-752c27492cbd',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 602.888964] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e3e0f6b2-2984-4938-adcc-0374a714ff76 in Status: SUCCESS [ 602.888964] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e3e0f6b2-2984-4938-adcc-0374a714ff76" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.178898] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 979debb6-884b-4873-b63c-4d693567f371 with status ACTIVE [ 603.179142] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.179405] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.179468] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.179691] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.179774] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.179957] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.180062] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.180122] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.180267] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.180335] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.180508] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.180595] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.184242] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.184242] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.184242] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.184242] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 979debb6-884b-4873-b63c-4d693567f371 is going to be updated. [ 603.193148] env[65306]: INFO networking_nsxv3.common.synchronization [req-0bf2daac-13e1-4f3c-a35a-af8bfb29f76e req-ce2a87ed-0f0f-43dd-aaa6-69d72e4e0a0f tempest-AttachInterfacesV270Test-932887390 tempest-AttachInterfacesV270Test-932887390-project-member] Enqueued Resource ID: a7dafaf4-f702-4dc9-bc77-265f5268966a with Priority: HIGHEST for action security_group_members [ 603.193683] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a7dafaf4-f702-4dc9-bc77-265f5268966a with Priority: HIGHEST for action security_group_members [ 603.193972] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-a7dafaf4-f702-4dc9-bc77-265f5268966a taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.194780] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a7dafaf4-f702-4dc9-bc77-265f5268966a" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.194780] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a7dafaf4-f702-4dc9-bc77-265f5268966a" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.194780] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a7dafaf4-f702-4dc9-bc77-265f5268966a" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.194780] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.194780] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.194780] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.195128] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.195128] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.195128] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a7dafaf4-f702-4dc9-bc77-265f5268966a',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 603.204415] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.204601] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.204715] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.204939] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.205098] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.205257] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-979debb6-884b-4873-b63c-4d693567f371" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.305052] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 861b72f3-5b3b-4f59-b255-ce5d00e42f50 [ 603.305692] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.305878] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.305949] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.306188] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.306563] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.306563] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:861b72f3-5b3b-4f59-b255-ce5d00e42f50 already deleted. [ 603.306563] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-861b72f3-5b3b-4f59-b255-ce5d00e42f50" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.327191] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 70b8bb37-9445-4339-82b5-ebb24bd0be78: rpc.has_security_group_logging(os_id): False [ 603.349278] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.349508] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.349570] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.349935] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.349935] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.350605] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.350605] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.350605] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.350605] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.350799] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.350852] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.350950] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.351037] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.351200] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.351284] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.351720] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.351720] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.351720] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.351831] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.351894] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.352017] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 70b8bb37-9445-4339-82b5-ebb24bd0be78 is going to be created. [ 603.366312] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.366510] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.366561] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.366862] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.366862] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.366970] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 37349b8b-c2c1-4141-8b10-752c27492cbd already deleted. [ 603.367020] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-37349b8b-c2c1-4141-8b10-752c27492cbd" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.447426] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.447612] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.447670] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.447851] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.448066] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.460617] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 70b8bb37-9445-4339-82b5-ebb24bd0be78 in Status: IN_PROGRESS for 2s [ 603.509881] env[65306]: INFO networking_nsxv3.common.synchronization [None req-3ebbca51-2cbe-4c7d-afdf-6a504c343f9f tempest-ServerActionsTestOtherB-1027609472 tempest-ServerActionsTestOtherB-1027609472-project-member] Enqueued Resource ID: 37349b8b-c2c1-4141-8b10-752c27492cbd with Priority: HIGHEST for action security_group_rules [ 603.511144] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 37349b8b-c2c1-4141-8b10-752c27492cbd with Priority: HIGHEST for action security_group_rules [ 603.511144] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock rules-37349b8b-c2c1-4141-8b10-752c27492cbd taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.511368] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-37349b8b-c2c1-4141-8b10-752c27492cbd" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.511368] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-37349b8b-c2c1-4141-8b10-752c27492cbd" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.511924] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-37349b8b-c2c1-4141-8b10-752c27492cbd" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.511924] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('37349b8b-c2c1-4141-8b10-752c27492cbd',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 603.698083] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.698083] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.698083] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.698274] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.698274] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.698557] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.698660] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.698720] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.698869] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.698964] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.699122] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a7dafaf4-f702-4dc9-bc77-265f5268966a already deleted. [ 603.699204] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a7dafaf4-f702-4dc9-bc77-265f5268966a" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.767774] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock network-410 taken with stack trace [, , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.767964] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "network-410" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.768095] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "network-410" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.768512] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "network-410" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.768715] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.768881] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.770027] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.770027] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.770027] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.770027] env[65306]: DEBUG dogpile.cache.region [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] No value present for key: 'zone-id' {{(pid=65306) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 603.770027] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] NeedRegenerationException {{(pid=65306) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 603.770027] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] no value, waiting for create lock {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 603.770027] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] value creation lock acquired {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 603.770027] env[65306]: DEBUG dogpile.cache.region [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] No value present for key: 'zone-id' {{(pid=65306) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 603.770027] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Calling creation function for not-yet-present value {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 603.770371] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 603.792690] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 603.792690] env[65306]: DEBUG dogpile.cache.region [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65306) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 603.792690] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Released creation lock {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 603.792949] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "network-410" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.793222] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock port-b541b157-8bee-4f75-aabd-b811e00e8f92 taken with stack trace [, , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.793408] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "port-b541b157-8bee-4f75-aabd-b811e00e8f92" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.793579] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "port-b541b157-8bee-4f75-aabd-b811e00e8f92" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.793831] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "port-b541b157-8bee-4f75-aabd-b811e00e8f92" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.793965] env[65306]: DEBUG networking_nsxv3.api.rpc [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b541b157-8bee-4f75-aabd-b811e00e8f92',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 604.033760] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.033760] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.033760] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.034993] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.034993] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.034993] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 37349b8b-c2c1-4141-8b10-752c27492cbd already deleted. [ 604.034993] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-37349b8b-c2c1-4141-8b10-752c27492cbd" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.296026] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.296296] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.296416] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.296759] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.296926] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.297095] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Segment Port b541b157-8bee-4f75-aabd-b811e00e8f92 not found, creating... [ 604.297351] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.297506] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.297621] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.297924] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.298127] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.298474] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.298610] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.299386] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.299386] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.299386] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.299386] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Resource: SegmentPort with ID: b541b157-8bee-4f75-aabd-b811e00e8f92 is going to be created. [ 604.347873] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.348198] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.348339] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.348705] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.348992] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.349311] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "port-b541b157-8bee-4f75-aabd-b811e00e8f92" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.407960] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: df9d38aa-4663-42d9-8451-f5b81969567d in Status: SUCCESS [ 604.408246] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-df9d38aa-4663-42d9-8451-f5b81969567d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.408451] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-df9d38aa-4663-42d9-8451-f5b81969567d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.408710] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-df9d38aa-4663-42d9-8451-f5b81969567d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.408917] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.409057] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.409127] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.409342] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.409462] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.409506] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('df9d38aa-4663-42d9-8451-f5b81969567d',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 604.911645] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('df9d38aa-4663-42d9-8451-f5b81969567d',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 605.098137] env[65306]: INFO networking_nsxv3.common.synchronization [req-0bf2daac-13e1-4f3c-a35a-af8bfb29f76e req-11f78843-7019-4402-bebd-6041e3c3db18 service nova] Enqueued Resource ID: a7dafaf4-f702-4dc9-bc77-265f5268966a with Priority: HIGHEST for action security_group_rules [ 605.098137] env[65306]: INFO networking_nsxv3.common.synchronization [req-0bf2daac-13e1-4f3c-a35a-af8bfb29f76e req-11f78843-7019-4402-bebd-6041e3c3db18 service nova] Enqueued Resource ID: a7dafaf4-f702-4dc9-bc77-265f5268966a with Priority: HIGHEST for action security_group_members [ 605.098137] env[65306]: INFO networking_nsxv3.common.synchronization [req-0bf2daac-13e1-4f3c-a35a-af8bfb29f76e req-11f78843-7019-4402-bebd-6041e3c3db18 service nova] Enqueued Resource ID: b541b157-8bee-4f75-aabd-b811e00e8f92 with Priority: HIGHEST for action port [ 605.098849] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a7dafaf4-f702-4dc9-bc77-265f5268966a with Priority: HIGHEST for action security_group_rules [ 605.099246] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a7dafaf4-f702-4dc9-bc77-265f5268966a with Priority: HIGHEST for action security_group_members [ 605.099373] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b541b157-8bee-4f75-aabd-b811e00e8f92 with Priority: HIGHEST for action port [ 605.101023] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a7dafaf4-f702-4dc9-bc77-265f5268966a taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.101023] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a7dafaf4-f702-4dc9-bc77-265f5268966a" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.101023] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a7dafaf4-f702-4dc9-bc77-265f5268966a" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.101023] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a7dafaf4-f702-4dc9-bc77-265f5268966a" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.101240] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a7dafaf4-f702-4dc9-bc77-265f5268966a',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 605.105895] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-a7dafaf4-f702-4dc9-bc77-265f5268966a taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.106040] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a7dafaf4-f702-4dc9-bc77-265f5268966a" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.106112] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a7dafaf4-f702-4dc9-bc77-265f5268966a" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.106376] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a7dafaf4-f702-4dc9-bc77-265f5268966a" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.106613] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.106681] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.106725] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.106884] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.106975] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.107081] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a7dafaf4-f702-4dc9-bc77-265f5268966a',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 605.107955] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock port-b541b157-8bee-4f75-aabd-b811e00e8f92 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.108123] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b541b157-8bee-4f75-aabd-b811e00e8f92" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.108299] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b541b157-8bee-4f75-aabd-b811e00e8f92" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.108299] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b541b157-8bee-4f75-aabd-b811e00e8f92" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.108448] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b541b157-8bee-4f75-aabd-b811e00e8f92',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 605.141990] env[65306]: INFO networking_nsxv3.common.synchronization [None req-969c2790-248b-4c54-96a0-915b246d3111 None None] Enqueued Resource ID: 431018fc-5259-41b9-83a4-df01c6bdb869 with Priority: HIGHEST for action port [ 605.143255] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 431018fc-5259-41b9-83a4-df01c6bdb869 with Priority: HIGHEST for action port [ 605.143255] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock port-431018fc-5259-41b9-83a4-df01c6bdb869 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.143255] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-431018fc-5259-41b9-83a4-df01c6bdb869" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.143255] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-431018fc-5259-41b9-83a4-df01c6bdb869" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.144470] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-431018fc-5259-41b9-83a4-df01c6bdb869" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.144470] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('431018fc-5259-41b9-83a4-df01c6bdb869',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 605.352988] env[65306]: INFO networking_nsxv3.common.synchronization [req-4f6566df-fe6d-4cc1-a01b-5fb27cc6dd5c req-b40f5407-c6b8-4ea7-83c3-c9b56544ecf6 tempest-MigrationsAdminTest-1842265666 tempest-MigrationsAdminTest-1842265666-project-member] Enqueued Resource ID: 8beaaac6-ba63-44e8-a960-7e228e2e7d37 with Priority: HIGHEST for action security_group_members [ 605.353745] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8beaaac6-ba63-44e8-a960-7e228e2e7d37 with Priority: HIGHEST for action security_group_members [ 605.354160] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-8beaaac6-ba63-44e8-a960-7e228e2e7d37 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.354289] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8beaaac6-ba63-44e8-a960-7e228e2e7d37" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.354351] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8beaaac6-ba63-44e8-a960-7e228e2e7d37" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.354609] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8beaaac6-ba63-44e8-a960-7e228e2e7d37" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.354773] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.354868] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.354921] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.355087] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.355175] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.355263] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8beaaac6-ba63-44e8-a960-7e228e2e7d37',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 605.415367] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('df9d38aa-4663-42d9-8451-f5b81969567d',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 605.476568] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 70b8bb37-9445-4339-82b5-ebb24bd0be78 in Status: SUCCESS [ 605.476791] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-70b8bb37-9445-4339-82b5-ebb24bd0be78" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.610368] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a7dafaf4-f702-4dc9-bc77-265f5268966a',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 605.611490] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-a7dafaf4-f702-4dc9-bc77-265f5268966a taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.611660] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a7dafaf4-f702-4dc9-bc77-265f5268966a" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.611897] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b541b157-8bee-4f75-aabd-b811e00e8f92 with status ACTIVE [ 605.611993] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.612138] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.612138] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.612452] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.612537] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.612678] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.612799] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.612839] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.612988] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.614736] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.614736] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.614736] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.614736] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.614736] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.614736] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.615299] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b541b157-8bee-4f75-aabd-b811e00e8f92 is going to be updated. [ 605.642992] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.643212] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.643255] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.643538] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.643685] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.643749] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b541b157-8bee-4f75-aabd-b811e00e8f92" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.649707] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 431018fc-5259-41b9-83a4-df01c6bdb869 [ 605.649707] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.650288] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.650288] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.650288] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.650288] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.650288] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:431018fc-5259-41b9-83a4-df01c6bdb869 already deleted. [ 605.651308] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-431018fc-5259-41b9-83a4-df01c6bdb869" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.761486] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock network-707 taken with stack trace [, , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.761707] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "network-707" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.761838] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "network-707" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.762148] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "network-707" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.762475] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.762661] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.762781] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.763016] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.763155] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.763397] env[65306]: DEBUG dogpile.cache.region [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] No value present for key: 'zone-id' {{(pid=65306) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 605.763528] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] NeedRegenerationException {{(pid=65306) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 605.763634] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] no value, waiting for create lock {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 605.763735] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] value creation lock acquired {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 605.763837] env[65306]: DEBUG dogpile.cache.region [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] No value present for key: 'zone-id' {{(pid=65306) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 605.764061] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Calling creation function for not-yet-present value {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 605.764122] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 605.801411] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 605.801411] env[65306]: DEBUG dogpile.cache.region [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Cache value generated in 0.036 seconds for key(s): 'zone-id' {{(pid=65306) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 605.801411] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Released creation lock {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 605.801411] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "network-707" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.801411] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock port-9a79c61d-15b5-4f7d-9f6e-88ca82deb5ec taken with stack trace [, , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.801411] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "port-9a79c61d-15b5-4f7d-9f6e-88ca82deb5ec" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.801411] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "port-9a79c61d-15b5-4f7d-9f6e-88ca82deb5ec" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.801411] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "port-9a79c61d-15b5-4f7d-9f6e-88ca82deb5ec" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.801411] env[65306]: DEBUG networking_nsxv3.api.rpc [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9a79c61d-15b5-4f7d-9f6e-88ca82deb5ec',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 605.857756] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.857930] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.858036] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.858258] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.858397] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.858697] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.858819] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.858920] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.859608] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.859608] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.859608] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8beaaac6-ba63-44e8-a960-7e228e2e7d37 already deleted. [ 605.859608] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8beaaac6-ba63-44e8-a960-7e228e2e7d37" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.918876] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.919097] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.919159] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.919327] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.919433] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.919535] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: df9d38aa-4663-42d9-8451-f5b81969567d is going to be updated. [ 605.958387] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.958387] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.958665] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.958715] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.958837] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.970933] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: df9d38aa-4663-42d9-8451-f5b81969567d in Status: IN_PROGRESS for 2s [ 606.117418] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a7dafaf4-f702-4dc9-bc77-265f5268966a',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 606.303638] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.303870] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.304036] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.304478] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.304578] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.304736] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Segment Port 9a79c61d-15b5-4f7d-9f6e-88ca82deb5ec not found, creating... [ 606.304910] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.305095] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.305254] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.305565] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.305565] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.305874] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.306066] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.306184] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.306553] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.306553] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.306734] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Resource: SegmentPort with ID: 9a79c61d-15b5-4f7d-9f6e-88ca82deb5ec is going to be created. [ 606.340983] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.341165] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.341564] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.341564] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.341811] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.342055] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "port-9a79c61d-15b5-4f7d-9f6e-88ca82deb5ec" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.621612] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.622327] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.622327] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.622327] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.622327] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.622327] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a7dafaf4-f702-4dc9-bc77-265f5268966a is going to be created. [ 606.649967] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.650166] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.650166] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.650342] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.650512] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.663513] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a7dafaf4-f702-4dc9-bc77-265f5268966a in Status: UNINITIALIZED for 2s [ 607.095462] env[65306]: INFO networking_nsxv3.common.synchronization [req-4f6566df-fe6d-4cc1-a01b-5fb27cc6dd5c req-3aa6bed8-6b4e-47e2-9c4c-4a50fb0f189f service nova] Enqueued Resource ID: 8beaaac6-ba63-44e8-a960-7e228e2e7d37 with Priority: HIGHEST for action security_group_rules [ 607.095624] env[65306]: INFO networking_nsxv3.common.synchronization [req-4f6566df-fe6d-4cc1-a01b-5fb27cc6dd5c req-3aa6bed8-6b4e-47e2-9c4c-4a50fb0f189f service nova] Enqueued Resource ID: 8beaaac6-ba63-44e8-a960-7e228e2e7d37 with Priority: HIGHEST for action security_group_members [ 607.096710] env[65306]: INFO networking_nsxv3.common.synchronization [req-4f6566df-fe6d-4cc1-a01b-5fb27cc6dd5c req-3aa6bed8-6b4e-47e2-9c4c-4a50fb0f189f service nova] Enqueued Resource ID: 9a79c61d-15b5-4f7d-9f6e-88ca82deb5ec with Priority: HIGHEST for action port [ 607.096710] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8beaaac6-ba63-44e8-a960-7e228e2e7d37 with Priority: HIGHEST for action security_group_rules [ 607.096710] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8beaaac6-ba63-44e8-a960-7e228e2e7d37 with Priority: HIGHEST for action security_group_members [ 607.096710] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9a79c61d-15b5-4f7d-9f6e-88ca82deb5ec with Priority: HIGHEST for action port [ 607.097113] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8beaaac6-ba63-44e8-a960-7e228e2e7d37 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.097240] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8beaaac6-ba63-44e8-a960-7e228e2e7d37" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.097376] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8beaaac6-ba63-44e8-a960-7e228e2e7d37" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.097644] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8beaaac6-ba63-44e8-a960-7e228e2e7d37" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.097644] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8beaaac6-ba63-44e8-a960-7e228e2e7d37',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 607.099241] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-8beaaac6-ba63-44e8-a960-7e228e2e7d37 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.099505] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8beaaac6-ba63-44e8-a960-7e228e2e7d37" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.099505] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8beaaac6-ba63-44e8-a960-7e228e2e7d37" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.099671] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8beaaac6-ba63-44e8-a960-7e228e2e7d37" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.100023] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.100157] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.100235] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.100402] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.102016] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.102016] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8beaaac6-ba63-44e8-a960-7e228e2e7d37',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 607.102532] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock port-9a79c61d-15b5-4f7d-9f6e-88ca82deb5ec taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.102698] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9a79c61d-15b5-4f7d-9f6e-88ca82deb5ec" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.102770] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9a79c61d-15b5-4f7d-9f6e-88ca82deb5ec" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.102944] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9a79c61d-15b5-4f7d-9f6e-88ca82deb5ec" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.103037] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9a79c61d-15b5-4f7d-9f6e-88ca82deb5ec',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 607.600318] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-8beaaac6-ba63-44e8-a960-7e228e2e7d37 taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.600318] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8beaaac6-ba63-44e8-a960-7e228e2e7d37" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.603537] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8beaaac6-ba63-44e8-a960-7e228e2e7d37',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 607.606592] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9a79c61d-15b5-4f7d-9f6e-88ca82deb5ec with status ACTIVE [ 607.606592] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.606592] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.606592] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.606592] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.606592] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.606941] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.606941] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.607116] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.607286] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.607742] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.607977] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.608145] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.608676] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.608899] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.612024] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.612024] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9a79c61d-15b5-4f7d-9f6e-88ca82deb5ec is going to be updated. [ 607.634866] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.634866] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.635186] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.636664] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.636890] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.637103] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9a79c61d-15b5-4f7d-9f6e-88ca82deb5ec" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.982174] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: df9d38aa-4663-42d9-8451-f5b81969567d in Status: SUCCESS [ 607.983942] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-df9d38aa-4663-42d9-8451-f5b81969567d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.984532] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-df9d38aa-4663-42d9-8451-f5b81969567d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.986015] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-df9d38aa-4663-42d9-8451-f5b81969567d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.986015] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.986015] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.986015] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.986015] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.986015] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.986015] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-df9d38aa-4663-42d9-8451-f5b81969567d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.986015] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('df9d38aa-4663-42d9-8451-f5b81969567d',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 607.987512] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-df9d38aa-4663-42d9-8451-f5b81969567d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.988025] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-df9d38aa-4663-42d9-8451-f5b81969567d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.988309] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.988839] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.989817] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.989817] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.989817] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.989817] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('df9d38aa-4663-42d9-8451-f5b81969567d',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 608.105323] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8beaaac6-ba63-44e8-a960-7e228e2e7d37',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 608.491554] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-df9d38aa-4663-42d9-8451-f5b81969567d taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.491883] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-df9d38aa-4663-42d9-8451-f5b81969567d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.491953] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('df9d38aa-4663-42d9-8451-f5b81969567d',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 608.608208] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.608831] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.611558] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.611558] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.611558] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.611558] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8beaaac6-ba63-44e8-a960-7e228e2e7d37 is going to be created. [ 608.644045] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.644045] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.644045] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.644045] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.644045] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.656394] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8beaaac6-ba63-44e8-a960-7e228e2e7d37 in Status: UNINITIALIZED for 2s [ 608.676226] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a7dafaf4-f702-4dc9-bc77-265f5268966a in Status: SUCCESS [ 608.678879] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a7dafaf4-f702-4dc9-bc77-265f5268966a" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.679895] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a7dafaf4-f702-4dc9-bc77-265f5268966a" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.680435] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a7dafaf4-f702-4dc9-bc77-265f5268966a" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.680595] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.680978] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.680978] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.681091] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.681421] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.681421] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a7dafaf4-f702-4dc9-bc77-265f5268966a" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.681421] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a7dafaf4-f702-4dc9-bc77-265f5268966a',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 608.802579] env[65306]: INFO networking_nsxv3.common.synchronization [None req-4ac10c56-c9c7-4472-9467-cc83e5950ce0 None None] Enqueued Resource ID: abdf93a3-f423-475c-8dab-af5a15c82d32 with Priority: HIGHEST for action port [ 608.803264] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: abdf93a3-f423-475c-8dab-af5a15c82d32 with Priority: HIGHEST for action port [ 608.803468] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock port-abdf93a3-f423-475c-8dab-af5a15c82d32 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.803623] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-abdf93a3-f423-475c-8dab-af5a15c82d32" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.803658] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-abdf93a3-f423-475c-8dab-af5a15c82d32" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.803915] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-abdf93a3-f423-475c-8dab-af5a15c82d32" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.806116] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('abdf93a3-f423-475c-8dab-af5a15c82d32',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 608.993778] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('df9d38aa-4663-42d9-8451-f5b81969567d',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 609.187026] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-a7dafaf4-f702-4dc9-bc77-265f5268966a taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.187026] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a7dafaf4-f702-4dc9-bc77-265f5268966a" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.187026] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a7dafaf4-f702-4dc9-bc77-265f5268966a" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.187026] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a7dafaf4-f702-4dc9-bc77-265f5268966a" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.187026] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.187026] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.187026] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.187026] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.187026] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.187026] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a7dafaf4-f702-4dc9-bc77-265f5268966a" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.187026] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-a7dafaf4-f702-4dc9-bc77-265f5268966a taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.187739] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a7dafaf4-f702-4dc9-bc77-265f5268966a" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.187739] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a7dafaf4-f702-4dc9-bc77-265f5268966a" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.187739] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a7dafaf4-f702-4dc9-bc77-265f5268966a" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.187739] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.187739] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.187739] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.188046] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.188046] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.188046] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a7dafaf4-f702-4dc9-bc77-265f5268966a" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.188179] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a7dafaf4-f702-4dc9-bc77-265f5268966a',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 609.309443] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port abdf93a3-f423-475c-8dab-af5a15c82d32 [ 609.309443] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.309443] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.309443] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.309443] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.309443] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.309443] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:abdf93a3-f423-475c-8dab-af5a15c82d32 already deleted. [ 609.309443] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-abdf93a3-f423-475c-8dab-af5a15c82d32" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.497269] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.498280] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.498280] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.498280] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.498280] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.498466] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: df9d38aa-4663-42d9-8451-f5b81969567d is going to be updated. [ 609.519051] env[65306]: INFO networking_nsxv3.common.synchronization [req-fd424c02-cee1-4a5c-a8a2-86d3baf17938 req-77195f91-010d-44d8-9315-9256d940814c tempest-ServersTestFqdnHostnames-1995899657 tempest-ServersTestFqdnHostnames-1995899657-project-member] Enqueued Resource ID: 830915ca-b7ed-480d-8dcc-06210706a96a with Priority: HIGHEST for action security_group_members [ 609.519051] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 830915ca-b7ed-480d-8dcc-06210706a96a with Priority: HIGHEST for action security_group_members [ 609.519051] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-830915ca-b7ed-480d-8dcc-06210706a96a taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.519051] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-830915ca-b7ed-480d-8dcc-06210706a96a" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.519051] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-830915ca-b7ed-480d-8dcc-06210706a96a" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.519051] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-830915ca-b7ed-480d-8dcc-06210706a96a" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.519051] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.519051] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.519051] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.519051] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.519051] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.519051] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('830915ca-b7ed-480d-8dcc-06210706a96a',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 609.528919] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.529085] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.529136] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.529915] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.529915] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.541974] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: df9d38aa-4663-42d9-8451-f5b81969567d in Status: IN_PROGRESS for 2s [ 609.694023] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a7dafaf4-f702-4dc9-bc77-265f5268966a: rpc.has_security_group_logging(os_id): False [ 609.713695] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.713893] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.713936] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.717852] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.717982] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.718269] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.718411] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.718511] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.718701] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.718780] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.718988] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.719138] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.719220] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.719378] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.719450] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.719656] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.719766] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.719841] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.720024] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.720100] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.720189] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a7dafaf4-f702-4dc9-bc77-265f5268966a is going to be created. [ 609.789946] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.790322] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.790496] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.792111] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.792111] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.804247] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a7dafaf4-f702-4dc9-bc77-265f5268966a in Status: IN_PROGRESS for 2s [ 609.947392] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock network-526 taken with stack trace [, , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.948423] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "network-526" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.948423] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "network-526" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.952345] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "network-526" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.952637] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.953062] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.953185] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.954488] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.954488] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.954690] env[65306]: DEBUG dogpile.cache.region [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] No value present for key: 'zone-id' {{(pid=65306) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 609.954833] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] NeedRegenerationException {{(pid=65306) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 609.954981] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] no value, waiting for create lock {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 609.955056] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] value creation lock acquired {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 609.955179] env[65306]: DEBUG dogpile.cache.region [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] No value present for key: 'zone-id' {{(pid=65306) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 609.955342] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Calling creation function for not-yet-present value {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 609.955420] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 609.976514] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 609.976514] env[65306]: DEBUG dogpile.cache.region [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65306) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 609.976514] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Released creation lock {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 609.976725] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "network-526" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.977123] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock port-8574a3f1-4f69-4923-9ef9-e8b3ac3e23e2 taken with stack trace [, , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.977385] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "port-8574a3f1-4f69-4923-9ef9-e8b3ac3e23e2" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.977550] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "port-8574a3f1-4f69-4923-9ef9-e8b3ac3e23e2" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.978339] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "port-8574a3f1-4f69-4923-9ef9-e8b3ac3e23e2" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.978705] env[65306]: DEBUG networking_nsxv3.api.rpc [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8574a3f1-4f69-4923-9ef9-e8b3ac3e23e2',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 610.023729] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.023729] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.023729] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.023729] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.023729] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.023729] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.023729] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.023729] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.023729] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.023729] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.023729] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 830915ca-b7ed-480d-8dcc-06210706a96a already deleted. [ 610.023729] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-830915ca-b7ed-480d-8dcc-06210706a96a" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.484245] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.484715] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.484840] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.485144] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.485292] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.485452] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Segment Port 8574a3f1-4f69-4923-9ef9-e8b3ac3e23e2 not found, creating... [ 610.485843] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.488749] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.488749] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.488749] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.488749] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.490924] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.490924] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.490924] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.491253] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.491253] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.491487] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Resource: SegmentPort with ID: 8574a3f1-4f69-4923-9ef9-e8b3ac3e23e2 is going to be created. [ 610.516947] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.517200] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.517367] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.518033] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.518033] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.518033] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "port-8574a3f1-4f69-4923-9ef9-e8b3ac3e23e2" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.670274] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8beaaac6-ba63-44e8-a960-7e228e2e7d37 in Status: SUCCESS [ 610.670756] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8beaaac6-ba63-44e8-a960-7e228e2e7d37" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.671149] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8beaaac6-ba63-44e8-a960-7e228e2e7d37" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.671208] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8beaaac6-ba63-44e8-a960-7e228e2e7d37" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.671414] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.672449] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.672449] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.672449] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.672651] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.672651] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8beaaac6-ba63-44e8-a960-7e228e2e7d37" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.672740] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8beaaac6-ba63-44e8-a960-7e228e2e7d37',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 611.179345] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-8beaaac6-ba63-44e8-a960-7e228e2e7d37 taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.179762] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8beaaac6-ba63-44e8-a960-7e228e2e7d37" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.179762] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8beaaac6-ba63-44e8-a960-7e228e2e7d37" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.179871] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8beaaac6-ba63-44e8-a960-7e228e2e7d37" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.180056] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.180180] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.180241] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.180356] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.180437] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.180534] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8beaaac6-ba63-44e8-a960-7e228e2e7d37" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.180683] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-8beaaac6-ba63-44e8-a960-7e228e2e7d37 taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.180802] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8beaaac6-ba63-44e8-a960-7e228e2e7d37" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.180866] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8beaaac6-ba63-44e8-a960-7e228e2e7d37" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.181018] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8beaaac6-ba63-44e8-a960-7e228e2e7d37" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.181156] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.181252] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.181312] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.181454] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.181530] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.181612] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8beaaac6-ba63-44e8-a960-7e228e2e7d37" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.181704] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8beaaac6-ba63-44e8-a960-7e228e2e7d37',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 611.321724] env[65306]: INFO networking_nsxv3.common.synchronization [req-fd424c02-cee1-4a5c-a8a2-86d3baf17938 req-71480c22-a9b2-49e8-ae21-277a2f07c3d8 service nova] Enqueued Resource ID: 830915ca-b7ed-480d-8dcc-06210706a96a with Priority: HIGHEST for action security_group_rules [ 611.322094] env[65306]: INFO networking_nsxv3.common.synchronization [req-fd424c02-cee1-4a5c-a8a2-86d3baf17938 req-71480c22-a9b2-49e8-ae21-277a2f07c3d8 service nova] Enqueued Resource ID: 830915ca-b7ed-480d-8dcc-06210706a96a with Priority: HIGHEST for action security_group_members [ 611.323216] env[65306]: INFO networking_nsxv3.common.synchronization [req-fd424c02-cee1-4a5c-a8a2-86d3baf17938 req-71480c22-a9b2-49e8-ae21-277a2f07c3d8 service nova] Enqueued Resource ID: 8574a3f1-4f69-4923-9ef9-e8b3ac3e23e2 with Priority: HIGHEST for action port [ 611.325503] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 830915ca-b7ed-480d-8dcc-06210706a96a with Priority: HIGHEST for action security_group_rules [ 611.325769] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 830915ca-b7ed-480d-8dcc-06210706a96a with Priority: HIGHEST for action security_group_members [ 611.325906] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8574a3f1-4f69-4923-9ef9-e8b3ac3e23e2 with Priority: HIGHEST for action port [ 611.326262] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock rules-830915ca-b7ed-480d-8dcc-06210706a96a taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.326454] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-830915ca-b7ed-480d-8dcc-06210706a96a" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.326560] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-830915ca-b7ed-480d-8dcc-06210706a96a" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.326809] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-830915ca-b7ed-480d-8dcc-06210706a96a" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.326924] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('830915ca-b7ed-480d-8dcc-06210706a96a',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 611.328478] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-830915ca-b7ed-480d-8dcc-06210706a96a taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.328609] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-830915ca-b7ed-480d-8dcc-06210706a96a" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.328609] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-830915ca-b7ed-480d-8dcc-06210706a96a" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.328769] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-830915ca-b7ed-480d-8dcc-06210706a96a" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.329119] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.330073] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.330241] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.331546] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.331546] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.331546] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('830915ca-b7ed-480d-8dcc-06210706a96a',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 611.331769] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock port-8574a3f1-4f69-4923-9ef9-e8b3ac3e23e2 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.331869] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8574a3f1-4f69-4923-9ef9-e8b3ac3e23e2" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.331869] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8574a3f1-4f69-4923-9ef9-e8b3ac3e23e2" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.332042] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8574a3f1-4f69-4923-9ef9-e8b3ac3e23e2" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.332143] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8574a3f1-4f69-4923-9ef9-e8b3ac3e23e2',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 611.515613] env[65306]: INFO networking_nsxv3.common.synchronization [None req-a2ac09c7-879c-41ec-82f1-8ab0583a8c6d None None] Enqueued Resource ID: 175fd99c-b8d6-45f2-8db7-b7e3de23cb8b with Priority: HIGHEST for action port [ 611.516507] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 175fd99c-b8d6-45f2-8db7-b7e3de23cb8b with Priority: HIGHEST for action port [ 611.516859] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock port-175fd99c-b8d6-45f2-8db7-b7e3de23cb8b taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.517019] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-175fd99c-b8d6-45f2-8db7-b7e3de23cb8b" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.517094] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-175fd99c-b8d6-45f2-8db7-b7e3de23cb8b" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.517366] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-175fd99c-b8d6-45f2-8db7-b7e3de23cb8b" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.517543] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('175fd99c-b8d6-45f2-8db7-b7e3de23cb8b',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 611.553317] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: df9d38aa-4663-42d9-8451-f5b81969567d in Status: SUCCESS [ 611.553469] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-df9d38aa-4663-42d9-8451-f5b81969567d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.553631] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-df9d38aa-4663-42d9-8451-f5b81969567d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.553847] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-df9d38aa-4663-42d9-8451-f5b81969567d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.554057] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.554194] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.554262] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.554431] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.554517] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.554604] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-df9d38aa-4663-42d9-8451-f5b81969567d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.554776] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-df9d38aa-4663-42d9-8451-f5b81969567d taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.554874] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-df9d38aa-4663-42d9-8451-f5b81969567d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.554945] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-df9d38aa-4663-42d9-8451-f5b81969567d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.555084] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-df9d38aa-4663-42d9-8451-f5b81969567d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.555238] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.555334] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.555395] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.555554] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.555625] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.555707] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-df9d38aa-4663-42d9-8451-f5b81969567d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.555829] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('df9d38aa-4663-42d9-8451-f5b81969567d',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 611.685908] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8beaaac6-ba63-44e8-a960-7e228e2e7d37: rpc.has_security_group_logging(os_id): False [ 611.707377] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.707569] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.707614] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.707852] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.707943] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.708798] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.708798] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.708798] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.708798] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.708798] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.709082] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.709082] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.709082] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.709178] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.709228] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.709446] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.710158] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.710158] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.710158] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.710158] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.710158] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8beaaac6-ba63-44e8-a960-7e228e2e7d37 is going to be created. [ 611.777934] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.778110] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.778185] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.778473] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.778666] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.792845] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8beaaac6-ba63-44e8-a960-7e228e2e7d37 in Status: IN_PROGRESS for 2s [ 611.817324] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a7dafaf4-f702-4dc9-bc77-265f5268966a in Status: SUCCESS [ 611.817587] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a7dafaf4-f702-4dc9-bc77-265f5268966a" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.834246] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-830915ca-b7ed-480d-8dcc-06210706a96a taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.834390] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-830915ca-b7ed-480d-8dcc-06210706a96a" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.834575] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('830915ca-b7ed-480d-8dcc-06210706a96a',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 611.836552] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8574a3f1-4f69-4923-9ef9-e8b3ac3e23e2 with status ACTIVE [ 611.836552] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.836552] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.836552] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.836552] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.836552] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.836552] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.837121] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.837121] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.837121] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.837121] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.837241] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.841030] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.841030] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.841030] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.841030] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.841030] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8574a3f1-4f69-4923-9ef9-e8b3ac3e23e2 is going to be updated. [ 611.875648] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.875824] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.875892] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.876246] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.876817] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.877391] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8574a3f1-4f69-4923-9ef9-e8b3ac3e23e2" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.021053] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 175fd99c-b8d6-45f2-8db7-b7e3de23cb8b [ 612.021053] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.021053] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.021053] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.021053] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.021053] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.022496] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:175fd99c-b8d6-45f2-8db7-b7e3de23cb8b already deleted. [ 612.022662] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-175fd99c-b8d6-45f2-8db7-b7e3de23cb8b" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.063478] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for df9d38aa-4663-42d9-8451-f5b81969567d: rpc.has_security_group_logging(os_id): False [ 612.085163] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.085434] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.085434] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.085669] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.085779] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.085998] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.086184] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.086184] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.086354] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.086461] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.086665] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.086775] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.086845] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.087163] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.087301] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.087563] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.087683] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.088799] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.089475] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.089604] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.089682] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: df9d38aa-4663-42d9-8451-f5b81969567d is going to be created. [ 612.158720] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.158900] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.158942] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.159134] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.159691] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.171246] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: df9d38aa-4663-42d9-8451-f5b81969567d in Status: IN_PROGRESS for 2s [ 612.339852] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('830915ca-b7ed-480d-8dcc-06210706a96a',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 612.570637] env[65306]: INFO networking_nsxv3.common.synchronization [req-4978178c-8ab8-4cc4-817c-6cc69e7b3ffc req-f0a42c9c-2d37-4c6a-a846-a93dd7cc7f2c tempest-VolumesAssistedSnapshotsTest-47459573 tempest-VolumesAssistedSnapshotsTest-47459573-project-member] Enqueued Resource ID: 5ec09b70-aa5a-48ff-b72f-a5c6c81190e0 with Priority: HIGHEST for action security_group_members [ 612.571240] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5ec09b70-aa5a-48ff-b72f-a5c6c81190e0 with Priority: HIGHEST for action security_group_members [ 612.571583] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-5ec09b70-aa5a-48ff-b72f-a5c6c81190e0 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.571711] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5ec09b70-aa5a-48ff-b72f-a5c6c81190e0" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.571791] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5ec09b70-aa5a-48ff-b72f-a5c6c81190e0" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.576113] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5ec09b70-aa5a-48ff-b72f-a5c6c81190e0" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.576318] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.576894] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.576894] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.576894] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.576894] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.577064] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5ec09b70-aa5a-48ff-b72f-a5c6c81190e0',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 612.843168] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.843776] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.843776] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.844206] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.844453] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.844814] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 830915ca-b7ed-480d-8dcc-06210706a96a is going to be created. [ 612.874467] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.874740] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.874740] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.874996] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.875227] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.888473] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 830915ca-b7ed-480d-8dcc-06210706a96a in Status: UNINITIALIZED for 2s [ 612.991772] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock network-697 taken with stack trace [, , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.992296] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "network-697" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.992794] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "network-697" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.995034] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "network-697" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.995034] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.995034] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.995034] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.995715] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.995715] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.995978] env[65306]: DEBUG dogpile.cache.region [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] No value present for key: 'zone-id' {{(pid=65306) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 612.996039] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] NeedRegenerationException {{(pid=65306) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 612.996150] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] no value, waiting for create lock {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 612.996255] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] value creation lock acquired {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 612.996396] env[65306]: DEBUG dogpile.cache.region [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] No value present for key: 'zone-id' {{(pid=65306) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 612.996533] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Calling creation function for not-yet-present value {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 612.996684] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 613.019703] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 613.019960] env[65306]: DEBUG dogpile.cache.region [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65306) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 613.020115] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Released creation lock {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 613.020320] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "network-697" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.020665] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock port-8b76e0cd-5304-44c7-b0fa-df66dd1131ea taken with stack trace [, , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.020869] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "port-8b76e0cd-5304-44c7-b0fa-df66dd1131ea" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.020988] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "port-8b76e0cd-5304-44c7-b0fa-df66dd1131ea" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.021323] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "port-8b76e0cd-5304-44c7-b0fa-df66dd1131ea" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.021461] env[65306]: DEBUG networking_nsxv3.api.rpc [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8b76e0cd-5304-44c7-b0fa-df66dd1131ea',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 613.081664] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.081845] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.081926] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.082164] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.082265] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.082468] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.082562] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.083202] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.083202] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.083202] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.083202] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5ec09b70-aa5a-48ff-b72f-a5c6c81190e0 already deleted. [ 613.083202] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5ec09b70-aa5a-48ff-b72f-a5c6c81190e0" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.531055] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.531451] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.531451] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.532089] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.532089] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.532089] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Segment Port 8b76e0cd-5304-44c7-b0fa-df66dd1131ea not found, creating... [ 613.532301] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.532386] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.532487] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.532645] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.532819] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.533131] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.533284] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.533398] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.533700] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.533767] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.533923] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Resource: SegmentPort with ID: 8b76e0cd-5304-44c7-b0fa-df66dd1131ea is going to be created. [ 613.556476] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.556683] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.556831] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.557085] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.557305] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.557555] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "port-8b76e0cd-5304-44c7-b0fa-df66dd1131ea" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.807095] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8beaaac6-ba63-44e8-a960-7e228e2e7d37 in Status: SUCCESS [ 613.807301] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8beaaac6-ba63-44e8-a960-7e228e2e7d37" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.185453] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: df9d38aa-4663-42d9-8451-f5b81969567d in Status: SUCCESS [ 614.185809] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-df9d38aa-4663-42d9-8451-f5b81969567d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.186110] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-df9d38aa-4663-42d9-8451-f5b81969567d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.186446] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-df9d38aa-4663-42d9-8451-f5b81969567d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.186601] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('df9d38aa-4663-42d9-8451-f5b81969567d',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 614.353856] env[65306]: INFO networking_nsxv3.common.synchronization [req-4978178c-8ab8-4cc4-817c-6cc69e7b3ffc req-a39ccfed-7407-41e8-b7d1-8cac7a87502d service nova] Enqueued Resource ID: 5ec09b70-aa5a-48ff-b72f-a5c6c81190e0 with Priority: HIGHEST for action security_group_rules [ 614.354158] env[65306]: INFO networking_nsxv3.common.synchronization [req-4978178c-8ab8-4cc4-817c-6cc69e7b3ffc req-a39ccfed-7407-41e8-b7d1-8cac7a87502d service nova] Enqueued Resource ID: 5ec09b70-aa5a-48ff-b72f-a5c6c81190e0 with Priority: HIGHEST for action security_group_members [ 614.354867] env[65306]: INFO networking_nsxv3.common.synchronization [req-4978178c-8ab8-4cc4-817c-6cc69e7b3ffc req-a39ccfed-7407-41e8-b7d1-8cac7a87502d service nova] Enqueued Resource ID: 8b76e0cd-5304-44c7-b0fa-df66dd1131ea with Priority: HIGHEST for action port [ 614.354867] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5ec09b70-aa5a-48ff-b72f-a5c6c81190e0 with Priority: HIGHEST for action security_group_rules [ 614.354949] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5ec09b70-aa5a-48ff-b72f-a5c6c81190e0 with Priority: HIGHEST for action security_group_members [ 614.354988] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8b76e0cd-5304-44c7-b0fa-df66dd1131ea with Priority: HIGHEST for action port [ 614.355339] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5ec09b70-aa5a-48ff-b72f-a5c6c81190e0 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.355529] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5ec09b70-aa5a-48ff-b72f-a5c6c81190e0" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.355600] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5ec09b70-aa5a-48ff-b72f-a5c6c81190e0" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.355812] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5ec09b70-aa5a-48ff-b72f-a5c6c81190e0" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.355986] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5ec09b70-aa5a-48ff-b72f-a5c6c81190e0',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 614.357686] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-5ec09b70-aa5a-48ff-b72f-a5c6c81190e0 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.357686] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5ec09b70-aa5a-48ff-b72f-a5c6c81190e0" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.357686] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5ec09b70-aa5a-48ff-b72f-a5c6c81190e0" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.358078] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5ec09b70-aa5a-48ff-b72f-a5c6c81190e0" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.358078] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.358078] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.358254] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.358301] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.358401] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.358716] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5ec09b70-aa5a-48ff-b72f-a5c6c81190e0',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 614.359624] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock port-8b76e0cd-5304-44c7-b0fa-df66dd1131ea taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.359825] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8b76e0cd-5304-44c7-b0fa-df66dd1131ea" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.359825] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8b76e0cd-5304-44c7-b0fa-df66dd1131ea" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.359970] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8b76e0cd-5304-44c7-b0fa-df66dd1131ea" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.360065] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8b76e0cd-5304-44c7-b0fa-df66dd1131ea',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 614.690089] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-df9d38aa-4663-42d9-8451-f5b81969567d taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.690484] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-df9d38aa-4663-42d9-8451-f5b81969567d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.690484] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-df9d38aa-4663-42d9-8451-f5b81969567d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.690778] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-df9d38aa-4663-42d9-8451-f5b81969567d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.690969] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.691086] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.691154] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.691329] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.691459] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.691599] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-df9d38aa-4663-42d9-8451-f5b81969567d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.692213] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('df9d38aa-4663-42d9-8451-f5b81969567d',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 614.861866] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-5ec09b70-aa5a-48ff-b72f-a5c6c81190e0 taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.862322] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5ec09b70-aa5a-48ff-b72f-a5c6c81190e0" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.862322] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5ec09b70-aa5a-48ff-b72f-a5c6c81190e0',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 614.863309] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8b76e0cd-5304-44c7-b0fa-df66dd1131ea with status ACTIVE [ 614.863454] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.863576] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.863648] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.863871] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.864081] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.864269] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.864370] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.864435] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.864645] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.864679] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.864855] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.864958] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.865437] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.865647] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.865894] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.866416] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8b76e0cd-5304-44c7-b0fa-df66dd1131ea is going to be updated. [ 614.902781] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.902884] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.904170] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.904170] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.904170] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.904170] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8b76e0cd-5304-44c7-b0fa-df66dd1131ea" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.905296] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 830915ca-b7ed-480d-8dcc-06210706a96a in Status: SUCCESS [ 614.905296] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-830915ca-b7ed-480d-8dcc-06210706a96a" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.905296] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-830915ca-b7ed-480d-8dcc-06210706a96a" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.905468] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-830915ca-b7ed-480d-8dcc-06210706a96a" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.905606] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.905718] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.905774] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.905990] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.906062] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.906097] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-830915ca-b7ed-480d-8dcc-06210706a96a" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.906188] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('830915ca-b7ed-480d-8dcc-06210706a96a',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 615.195580] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-df9d38aa-4663-42d9-8451-f5b81969567d taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.195580] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-df9d38aa-4663-42d9-8451-f5b81969567d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.195580] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-df9d38aa-4663-42d9-8451-f5b81969567d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.195580] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-df9d38aa-4663-42d9-8451-f5b81969567d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.195580] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.195918] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.195918] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.195918] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.196027] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.196059] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-df9d38aa-4663-42d9-8451-f5b81969567d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.196276] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-df9d38aa-4663-42d9-8451-f5b81969567d taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.196276] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-df9d38aa-4663-42d9-8451-f5b81969567d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.196404] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-df9d38aa-4663-42d9-8451-f5b81969567d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.196543] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-df9d38aa-4663-42d9-8451-f5b81969567d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.197251] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.197251] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.197251] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.197251] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.197251] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.197251] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-df9d38aa-4663-42d9-8451-f5b81969567d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.197251] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('df9d38aa-4663-42d9-8451-f5b81969567d',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 615.371623] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5ec09b70-aa5a-48ff-b72f-a5c6c81190e0',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 615.412326] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('830915ca-b7ed-480d-8dcc-06210706a96a',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 615.700899] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for df9d38aa-4663-42d9-8451-f5b81969567d: rpc.has_security_group_logging(os_id): False [ 615.718869] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.719111] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.720744] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.720744] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.720744] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.720744] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.720744] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.720744] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.720744] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.720744] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.720744] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.720744] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.720744] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.720744] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.720744] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.721301] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.721301] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.721383] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.722050] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.722050] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.722050] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: df9d38aa-4663-42d9-8451-f5b81969567d is going to be updated. [ 615.788381] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.788707] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.788707] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.788898] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.789118] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.804267] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: df9d38aa-4663-42d9-8451-f5b81969567d in Status: IN_PROGRESS for 2s [ 615.874904] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.875100] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.875292] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.875669] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.875784] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.875899] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5ec09b70-aa5a-48ff-b72f-a5c6c81190e0 is going to be created. [ 615.915115] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 830915ca-b7ed-480d-8dcc-06210706a96a: rpc.has_security_group_logging(os_id): False [ 615.921924] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.921924] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.921924] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.921924] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.921924] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.929683] env[65306]: INFO networking_nsxv3.common.synchronization [req-33baf992-7f50-4fc1-aaef-8454f4fff03a req-d442a6f7-60f1-4c37-8613-4d44b14d230c tempest-VolumesAdminNegativeTest-357972443 tempest-VolumesAdminNegativeTest-357972443-project-member] Enqueued Resource ID: ed6cda65-baf0-42a6-bcdd-7a946b27c841 with Priority: HIGHEST for action security_group_members [ 615.930723] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ed6cda65-baf0-42a6-bcdd-7a946b27c841 with Priority: HIGHEST for action security_group_members [ 615.931172] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-ed6cda65-baf0-42a6-bcdd-7a946b27c841 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.931331] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ed6cda65-baf0-42a6-bcdd-7a946b27c841" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.932717] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ed6cda65-baf0-42a6-bcdd-7a946b27c841" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.932717] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ed6cda65-baf0-42a6-bcdd-7a946b27c841" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.932717] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.932717] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.932717] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.932717] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.932717] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.933212] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ed6cda65-baf0-42a6-bcdd-7a946b27c841',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 615.938031] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5ec09b70-aa5a-48ff-b72f-a5c6c81190e0 in Status: UNINITIALIZED for 2s [ 615.939773] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.939890] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.939991] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.940339] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.940443] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.940758] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.940944] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.944293] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.944293] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.944293] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.944293] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 830915ca-b7ed-480d-8dcc-06210706a96a is going to be created. [ 616.019523] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.019956] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.019956] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.020289] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.020612] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.037889] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 830915ca-b7ed-480d-8dcc-06210706a96a in Status: IN_PROGRESS for 2s [ 616.436871] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock network-445 taken with stack trace [, , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.437128] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "network-445" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.437312] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "network-445" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.437536] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "network-445" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.437815] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.437971] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.441230] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.441572] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.441756] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.441978] env[65306]: DEBUG dogpile.cache.region [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] No value present for key: 'zone-id' {{(pid=65306) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 616.442096] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] NeedRegenerationException {{(pid=65306) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 616.442203] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] no value, waiting for create lock {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 616.442344] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] value creation lock acquired {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 616.442417] env[65306]: DEBUG dogpile.cache.region [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] No value present for key: 'zone-id' {{(pid=65306) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 616.442503] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Calling creation function for not-yet-present value {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 616.442626] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 616.445347] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.445469] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.445532] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.445718] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.445812] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.445988] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.446819] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.446899] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.447052] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.447166] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.447261] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ed6cda65-baf0-42a6-bcdd-7a946b27c841 already deleted. [ 616.447299] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ed6cda65-baf0-42a6-bcdd-7a946b27c841" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.467581] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 616.467703] env[65306]: DEBUG dogpile.cache.region [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=65306) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 616.467855] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Released creation lock {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 616.468018] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "network-445" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.468328] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock port-26f08090-bd41-431e-a890-a456f790c98a taken with stack trace [, , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.468527] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "port-26f08090-bd41-431e-a890-a456f790c98a" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.468653] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "port-26f08090-bd41-431e-a890-a456f790c98a" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.468961] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "port-26f08090-bd41-431e-a890-a456f790c98a" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.469107] env[65306]: DEBUG networking_nsxv3.api.rpc [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('26f08090-bd41-431e-a890-a456f790c98a',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 616.973048] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.973048] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.973048] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.973048] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.973048] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.973048] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Segment Port 26f08090-bd41-431e-a890-a456f790c98a not found, creating... [ 616.973788] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.973788] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.973788] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.973788] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.973788] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.974073] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.975257] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.975257] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.975257] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.975440] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.975504] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Resource: SegmentPort with ID: 26f08090-bd41-431e-a890-a456f790c98a is going to be created. [ 616.998444] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.998849] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.999009] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.999301] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.999527] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.999976] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "port-26f08090-bd41-431e-a890-a456f790c98a" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.717487] env[65306]: INFO networking_nsxv3.common.synchronization [req-33baf992-7f50-4fc1-aaef-8454f4fff03a req-c2210d3f-24f5-4c38-ae8f-316c19cf2c35 service nova] Enqueued Resource ID: ed6cda65-baf0-42a6-bcdd-7a946b27c841 with Priority: HIGHEST for action security_group_rules [ 617.717487] env[65306]: INFO networking_nsxv3.common.synchronization [req-33baf992-7f50-4fc1-aaef-8454f4fff03a req-c2210d3f-24f5-4c38-ae8f-316c19cf2c35 service nova] Enqueued Resource ID: ed6cda65-baf0-42a6-bcdd-7a946b27c841 with Priority: HIGHEST for action security_group_members [ 617.717487] env[65306]: INFO networking_nsxv3.common.synchronization [req-33baf992-7f50-4fc1-aaef-8454f4fff03a req-c2210d3f-24f5-4c38-ae8f-316c19cf2c35 service nova] Enqueued Resource ID: 26f08090-bd41-431e-a890-a456f790c98a with Priority: HIGHEST for action port [ 617.717487] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ed6cda65-baf0-42a6-bcdd-7a946b27c841 with Priority: HIGHEST for action security_group_rules [ 617.717487] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ed6cda65-baf0-42a6-bcdd-7a946b27c841 with Priority: HIGHEST for action security_group_members [ 617.718196] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 26f08090-bd41-431e-a890-a456f790c98a with Priority: HIGHEST for action port [ 617.718196] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ed6cda65-baf0-42a6-bcdd-7a946b27c841 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.718196] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ed6cda65-baf0-42a6-bcdd-7a946b27c841" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.718196] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ed6cda65-baf0-42a6-bcdd-7a946b27c841" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.718468] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ed6cda65-baf0-42a6-bcdd-7a946b27c841" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.718590] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ed6cda65-baf0-42a6-bcdd-7a946b27c841',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 617.719741] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-ed6cda65-baf0-42a6-bcdd-7a946b27c841 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.719881] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ed6cda65-baf0-42a6-bcdd-7a946b27c841" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.719948] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ed6cda65-baf0-42a6-bcdd-7a946b27c841" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.720205] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ed6cda65-baf0-42a6-bcdd-7a946b27c841" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.720944] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.721080] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.721144] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.721335] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.723081] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.723081] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ed6cda65-baf0-42a6-bcdd-7a946b27c841',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 617.723081] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock port-26f08090-bd41-431e-a890-a456f790c98a taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.723081] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-26f08090-bd41-431e-a890-a456f790c98a" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.723427] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-26f08090-bd41-431e-a890-a456f790c98a" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.723427] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-26f08090-bd41-431e-a890-a456f790c98a" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.723556] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('26f08090-bd41-431e-a890-a456f790c98a',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 617.819792] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: df9d38aa-4663-42d9-8451-f5b81969567d in Status: SUCCESS [ 617.819792] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-df9d38aa-4663-42d9-8451-f5b81969567d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.952434] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5ec09b70-aa5a-48ff-b72f-a5c6c81190e0 in Status: SUCCESS [ 617.953018] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5ec09b70-aa5a-48ff-b72f-a5c6c81190e0" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.953267] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5ec09b70-aa5a-48ff-b72f-a5c6c81190e0" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.953725] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5ec09b70-aa5a-48ff-b72f-a5c6c81190e0" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.953939] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.954145] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.954220] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.954409] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.955076] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.955255] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5ec09b70-aa5a-48ff-b72f-a5c6c81190e0" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.955441] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5ec09b70-aa5a-48ff-b72f-a5c6c81190e0',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 618.056671] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 830915ca-b7ed-480d-8dcc-06210706a96a in Status: SUCCESS [ 618.056671] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-830915ca-b7ed-480d-8dcc-06210706a96a" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.225998] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ed6cda65-baf0-42a6-bcdd-7a946b27c841',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 618.227293] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-ed6cda65-baf0-42a6-bcdd-7a946b27c841 taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.227445] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ed6cda65-baf0-42a6-bcdd-7a946b27c841" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.227573] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 26f08090-bd41-431e-a890-a456f790c98a with status ACTIVE [ 618.227786] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.228057] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.228057] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.232805] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.232805] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.232805] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.233065] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.235726] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.235726] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.235726] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.235726] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.235726] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.235726] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.235726] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.235726] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.235726] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 26f08090-bd41-431e-a890-a456f790c98a is going to be updated. [ 618.264519] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.264519] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.265423] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.265423] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.265423] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.265423] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-26f08090-bd41-431e-a890-a456f790c98a" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.460042] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5ec09b70-aa5a-48ff-b72f-a5c6c81190e0',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 618.496136] env[65306]: INFO networking_nsxv3.common.synchronization [req-1fd4cbc4-d3b4-4e8d-b157-ee6e6fd4fa99 req-bdf85fce-01de-4b87-b93b-c05d6a518217 tempest-ServerActionsTestOtherB-1027609472 tempest-ServerActionsTestOtherB-1027609472-project-member] Enqueued Resource ID: 37349b8b-c2c1-4141-8b10-752c27492cbd with Priority: HIGHEST for action security_group_members [ 618.496136] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 37349b8b-c2c1-4141-8b10-752c27492cbd with Priority: HIGHEST for action security_group_members [ 618.496481] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-37349b8b-c2c1-4141-8b10-752c27492cbd taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.496580] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-37349b8b-c2c1-4141-8b10-752c27492cbd" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.496580] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-37349b8b-c2c1-4141-8b10-752c27492cbd" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.496874] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-37349b8b-c2c1-4141-8b10-752c27492cbd" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.497112] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.497112] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.497112] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.497306] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.497343] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.497656] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('37349b8b-c2c1-4141-8b10-752c27492cbd',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 618.607135] env[65306]: INFO networking_nsxv3.common.synchronization [None req-e00b5473-6c25-4421-883b-1aaed34b26e2 tempest-ServersWithSpecificFlavorTestJSON-1706838422 tempest-ServersWithSpecificFlavorTestJSON-1706838422-project-member] Enqueued Resource ID: ef5de9e7-0c3b-4386-af3c-de134eff75f3 with Priority: HIGHEST for action security_group_rules [ 618.607668] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ef5de9e7-0c3b-4386-af3c-de134eff75f3 with Priority: HIGHEST for action security_group_rules [ 618.607977] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ef5de9e7-0c3b-4386-af3c-de134eff75f3 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.609255] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ef5de9e7-0c3b-4386-af3c-de134eff75f3" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.609931] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ef5de9e7-0c3b-4386-af3c-de134eff75f3" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.610598] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ef5de9e7-0c3b-4386-af3c-de134eff75f3" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.610707] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ef5de9e7-0c3b-4386-af3c-de134eff75f3',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 618.706211] env[65306]: INFO networking_nsxv3.common.synchronization [None req-70fdd8bc-bfca-4287-aafd-5679a7acd897 tempest-ServersWithSpecificFlavorTestJSON-1706838422 tempest-ServersWithSpecificFlavorTestJSON-1706838422-project-member] Enqueued Resource ID: ef5de9e7-0c3b-4386-af3c-de134eff75f3 with Priority: HIGHEST for action security_group_rules [ 618.707042] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ef5de9e7-0c3b-4386-af3c-de134eff75f3 with Priority: HIGHEST for action security_group_rules [ 618.707514] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ef5de9e7-0c3b-4386-af3c-de134eff75f3 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.707862] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ef5de9e7-0c3b-4386-af3c-de134eff75f3" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.738630] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ed6cda65-baf0-42a6-bcdd-7a946b27c841',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 618.842278] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock network-221 taken with stack trace [, , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.842481] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "network-221" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.842596] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "network-221" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.842962] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "network-221" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.843276] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.843463] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.843599] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.843853] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.843995] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.844402] env[65306]: DEBUG dogpile.cache.region [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] No value present for key: 'zone-id' {{(pid=65306) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 618.844594] env[65306]: DEBUG dogpile.lock [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] NeedRegenerationException {{(pid=65306) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 618.844732] env[65306]: DEBUG dogpile.lock [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] no value, waiting for create lock {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 618.844837] env[65306]: DEBUG dogpile.lock [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] value creation lock acquired {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 618.844958] env[65306]: DEBUG dogpile.cache.region [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] No value present for key: 'zone-id' {{(pid=65306) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 618.845081] env[65306]: DEBUG dogpile.lock [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Calling creation function for not-yet-present value {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 618.845231] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 618.865427] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 618.865694] env[65306]: DEBUG dogpile.cache.region [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65306) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 618.865910] env[65306]: DEBUG dogpile.lock [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Released creation lock {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 618.866046] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "network-221" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.866415] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock port-9de4c47a-170c-420a-bffa-924d3629a6c0 taken with stack trace [, , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.866635] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "port-9de4c47a-170c-420a-bffa-924d3629a6c0" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.866723] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "port-9de4c47a-170c-420a-bffa-924d3629a6c0" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.867070] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "port-9de4c47a-170c-420a-bffa-924d3629a6c0" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.867221] env[65306]: DEBUG networking_nsxv3.api.rpc [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9de4c47a-170c-420a-bffa-924d3629a6c0',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 618.961764] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5ec09b70-aa5a-48ff-b72f-a5c6c81190e0: rpc.has_security_group_logging(os_id): False [ 618.989927] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.990156] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.990235] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.990423] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.990546] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.990886] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.991014] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.991124] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.991305] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.991414] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.991508] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5ec09b70-aa5a-48ff-b72f-a5c6c81190e0 is going to be created. [ 619.000984] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.001202] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.001368] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.001710] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.001900] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.002295] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.002526] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.002671] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.002960] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.003175] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.003596] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 37349b8b-c2c1-4141-8b10-752c27492cbd already deleted. [ 619.003596] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-37349b8b-c2c1-4141-8b10-752c27492cbd" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.085674] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.086087] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.086087] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.086165] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.086343] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.099283] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5ec09b70-aa5a-48ff-b72f-a5c6c81190e0 in Status: IN_PROGRESS for 2s [ 619.132689] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.132922] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.132922] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.133236] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.133399] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.133503] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ef5de9e7-0c3b-4386-af3c-de134eff75f3 already deleted. [ 619.133591] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ef5de9e7-0c3b-4386-af3c-de134eff75f3" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.133763] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ef5de9e7-0c3b-4386-af3c-de134eff75f3" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.133955] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ef5de9e7-0c3b-4386-af3c-de134eff75f3" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.134061] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ef5de9e7-0c3b-4386-af3c-de134eff75f3',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 619.241228] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.241441] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.241572] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.241830] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.241929] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.242084] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ed6cda65-baf0-42a6-bcdd-7a946b27c841 is going to be created. [ 619.283072] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.283258] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.283367] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.283574] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.283756] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.295449] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ed6cda65-baf0-42a6-bcdd-7a946b27c841 in Status: UNINITIALIZED for 2s [ 619.370090] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.370336] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.370461] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.370799] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.370970] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.373176] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Segment Port 9de4c47a-170c-420a-bffa-924d3629a6c0 not found, creating... [ 619.373176] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.373176] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.373176] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.373176] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.373176] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.373176] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.373176] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.373176] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.373176] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.373914] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.373914] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Resource: SegmentPort with ID: 9de4c47a-170c-420a-bffa-924d3629a6c0 is going to be created. [ 619.401658] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.401939] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.402009] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.402285] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.402493] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.402726] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "port-9de4c47a-170c-420a-bffa-924d3629a6c0" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.658322] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.658482] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.658592] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.659391] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.659391] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.659391] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ef5de9e7-0c3b-4386-af3c-de134eff75f3 already deleted. [ 619.659391] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ef5de9e7-0c3b-4386-af3c-de134eff75f3" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.141739] env[65306]: INFO networking_nsxv3.common.synchronization [req-1fd4cbc4-d3b4-4e8d-b157-ee6e6fd4fa99 req-5aa13f2e-f6c7-41d1-b13c-557d24d569ec service nova] Enqueued Resource ID: 37349b8b-c2c1-4141-8b10-752c27492cbd with Priority: HIGHEST for action security_group_rules [ 620.142064] env[65306]: INFO networking_nsxv3.common.synchronization [req-1fd4cbc4-d3b4-4e8d-b157-ee6e6fd4fa99 req-5aa13f2e-f6c7-41d1-b13c-557d24d569ec service nova] Enqueued Resource ID: 37349b8b-c2c1-4141-8b10-752c27492cbd with Priority: HIGHEST for action security_group_members [ 620.142064] env[65306]: INFO networking_nsxv3.common.synchronization [req-1fd4cbc4-d3b4-4e8d-b157-ee6e6fd4fa99 req-5aa13f2e-f6c7-41d1-b13c-557d24d569ec service nova] Enqueued Resource ID: 9de4c47a-170c-420a-bffa-924d3629a6c0 with Priority: HIGHEST for action port [ 620.142670] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 37349b8b-c2c1-4141-8b10-752c27492cbd with Priority: HIGHEST for action security_group_rules [ 620.143716] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 37349b8b-c2c1-4141-8b10-752c27492cbd with Priority: HIGHEST for action security_group_members [ 620.143716] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9de4c47a-170c-420a-bffa-924d3629a6c0 with Priority: HIGHEST for action port [ 620.143716] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock rules-37349b8b-c2c1-4141-8b10-752c27492cbd taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.143716] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-37349b8b-c2c1-4141-8b10-752c27492cbd" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.143716] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-37349b8b-c2c1-4141-8b10-752c27492cbd" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.143716] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-37349b8b-c2c1-4141-8b10-752c27492cbd" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.143716] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('37349b8b-c2c1-4141-8b10-752c27492cbd',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 620.144550] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-37349b8b-c2c1-4141-8b10-752c27492cbd taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.146036] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-37349b8b-c2c1-4141-8b10-752c27492cbd" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.146129] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-37349b8b-c2c1-4141-8b10-752c27492cbd" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.146333] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-37349b8b-c2c1-4141-8b10-752c27492cbd" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.146591] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.146708] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.146775] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.146938] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.147043] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.147144] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('37349b8b-c2c1-4141-8b10-752c27492cbd',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 620.147993] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock port-9de4c47a-170c-420a-bffa-924d3629a6c0 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.148128] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9de4c47a-170c-420a-bffa-924d3629a6c0" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.148198] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9de4c47a-170c-420a-bffa-924d3629a6c0" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.149228] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9de4c47a-170c-420a-bffa-924d3629a6c0" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.149228] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9de4c47a-170c-420a-bffa-924d3629a6c0',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 620.651492] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-37349b8b-c2c1-4141-8b10-752c27492cbd taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.651492] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-37349b8b-c2c1-4141-8b10-752c27492cbd" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.651492] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('37349b8b-c2c1-4141-8b10-752c27492cbd',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 620.653983] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9de4c47a-170c-420a-bffa-924d3629a6c0 with status ACTIVE [ 620.653983] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.653983] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.653983] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.654216] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.654216] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.654509] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.654644] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.654719] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.654850] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.654963] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.655202] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.655369] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.655424] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.655584] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.655661] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.655771] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9de4c47a-170c-420a-bffa-924d3629a6c0 is going to be updated. [ 620.681468] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.681657] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.681737] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.681957] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.682109] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.682272] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9de4c47a-170c-420a-bffa-924d3629a6c0" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.733343] env[65306]: INFO networking_nsxv3.common.synchronization [req-9bb1d8c6-95c0-42d7-9301-bdbcce82a119 req-4762a1cd-7bcd-488b-8cf9-6b51c49e8f87 tempest-DeleteServersAdminTestJSON-1268376729 tempest-DeleteServersAdminTestJSON-1268376729-project-admin] Enqueued Resource ID: 70b8bb37-9445-4339-82b5-ebb24bd0be78 with Priority: HIGHEST for action security_group_members [ 620.733706] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 70b8bb37-9445-4339-82b5-ebb24bd0be78 with Priority: HIGHEST for action security_group_members [ 620.737023] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-70b8bb37-9445-4339-82b5-ebb24bd0be78 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.737023] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-70b8bb37-9445-4339-82b5-ebb24bd0be78" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.737023] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-70b8bb37-9445-4339-82b5-ebb24bd0be78" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.737023] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-70b8bb37-9445-4339-82b5-ebb24bd0be78" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.737023] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.737023] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.737023] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.737023] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.737023] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.737023] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('70b8bb37-9445-4339-82b5-ebb24bd0be78',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 620.767034] env[65306]: INFO networking_nsxv3.common.synchronization [req-e0a29617-f34f-4121-a3ce-f972c5027de8 req-8abb100d-880d-4c96-9c35-2b5fd632ef2f tempest-ListServersNegativeTestJSON-1230971190 tempest-ListServersNegativeTestJSON-1230971190-project-member] Enqueued Resource ID: 6951f012-9730-40bd-a7af-9b70cd598b05 with Priority: HIGHEST for action security_group_members [ 620.768102] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6951f012-9730-40bd-a7af-9b70cd598b05 with Priority: HIGHEST for action security_group_members [ 620.768102] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-6951f012-9730-40bd-a7af-9b70cd598b05 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.769457] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6951f012-9730-40bd-a7af-9b70cd598b05" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.769457] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6951f012-9730-40bd-a7af-9b70cd598b05" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.769457] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6951f012-9730-40bd-a7af-9b70cd598b05" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.769457] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.769457] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.769457] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.769457] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.769457] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.769457] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6951f012-9730-40bd-a7af-9b70cd598b05',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 621.112910] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5ec09b70-aa5a-48ff-b72f-a5c6c81190e0 in Status: SUCCESS [ 621.113163] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5ec09b70-aa5a-48ff-b72f-a5c6c81190e0" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.157771] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('37349b8b-c2c1-4141-8b10-752c27492cbd',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 621.172859] env[65306]: INFO networking_nsxv3.common.synchronization [None req-05502af2-ee21-4182-8737-62fdf5f2314a None None] Enqueued Resource ID: 6593add2-f4d8-4706-9929-8828edf16a20 with Priority: HIGHEST for action port [ 621.173554] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6593add2-f4d8-4706-9929-8828edf16a20 with Priority: HIGHEST for action port [ 621.173947] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock port-6593add2-f4d8-4706-9929-8828edf16a20 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.174222] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6593add2-f4d8-4706-9929-8828edf16a20" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.174346] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6593add2-f4d8-4706-9929-8828edf16a20" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.174863] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6593add2-f4d8-4706-9929-8828edf16a20" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.175046] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6593add2-f4d8-4706-9929-8828edf16a20',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 621.238721] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.238968] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.238968] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.239186] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.239301] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.239564] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.239753] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.239908] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.240035] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.240163] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.240221] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 70b8bb37-9445-4339-82b5-ebb24bd0be78 is going to be updated. [ 621.247405] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock network-823 taken with stack trace [, , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.247619] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "network-823" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.247774] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "network-823" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.248178] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "network-823" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.248575] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.248801] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.248982] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.249286] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.249468] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.249737] env[65306]: DEBUG dogpile.cache.region [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] No value present for key: 'zone-id' {{(pid=65306) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 621.249878] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] NeedRegenerationException {{(pid=65306) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 621.249997] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] no value, waiting for create lock {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 621.250100] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] value creation lock acquired {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 621.250216] env[65306]: DEBUG dogpile.cache.region [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] No value present for key: 'zone-id' {{(pid=65306) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 621.250314] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Calling creation function for not-yet-present value {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 621.250460] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 621.274789] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 621.274789] env[65306]: DEBUG dogpile.cache.region [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65306) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 621.274789] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Released creation lock {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 621.274789] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "network-823" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.274789] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock port-b0e2b15f-7345-4948-a9aa-bf248789fd47 taken with stack trace [, , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.275122] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "port-b0e2b15f-7345-4948-a9aa-bf248789fd47" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.275510] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "port-b0e2b15f-7345-4948-a9aa-bf248789fd47" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.275630] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "port-b0e2b15f-7345-4948-a9aa-bf248789fd47" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.275699] env[65306]: DEBUG networking_nsxv3.api.rpc [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b0e2b15f-7345-4948-a9aa-bf248789fd47',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 621.279585] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.279585] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.279792] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.279985] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.279985] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.280390] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.280390] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.280390] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.280498] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.280498] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.281296] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6951f012-9730-40bd-a7af-9b70cd598b05 already deleted. [ 621.281296] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6951f012-9730-40bd-a7af-9b70cd598b05" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.283594] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.283594] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.283748] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.284043] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.284043] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.302441] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 70b8bb37-9445-4339-82b5-ebb24bd0be78 in Status: IN_PROGRESS for 2s [ 621.306359] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ed6cda65-baf0-42a6-bcdd-7a946b27c841 in Status: SUCCESS [ 621.306603] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ed6cda65-baf0-42a6-bcdd-7a946b27c841" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.307254] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ed6cda65-baf0-42a6-bcdd-7a946b27c841" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.307346] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ed6cda65-baf0-42a6-bcdd-7a946b27c841" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.307534] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.307654] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.307718] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.307878] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.307946] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.308049] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ed6cda65-baf0-42a6-bcdd-7a946b27c841" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.308143] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ed6cda65-baf0-42a6-bcdd-7a946b27c841',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 621.660670] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.660670] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.660670] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.661086] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.661086] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.661086] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 37349b8b-c2c1-4141-8b10-752c27492cbd is going to be created. [ 621.681207] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6593add2-f4d8-4706-9929-8828edf16a20 [ 621.681468] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.681606] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.681680] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.681918] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.682013] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.682118] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6593add2-f4d8-4706-9929-8828edf16a20 already deleted. [ 621.682203] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6593add2-f4d8-4706-9929-8828edf16a20" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.688137] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.688137] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.688137] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.688137] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.688137] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.702782] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 37349b8b-c2c1-4141-8b10-752c27492cbd in Status: UNINITIALIZED for 2s [ 621.782876] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.782962] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.783091] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.783401] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.783718] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.783890] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Segment Port b0e2b15f-7345-4948-a9aa-bf248789fd47 not found, creating... [ 621.784170] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.784340] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.784451] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.784673] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.784832] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.785151] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.785303] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.785414] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.785614] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.785759] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.785904] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Resource: SegmentPort with ID: b0e2b15f-7345-4948-a9aa-bf248789fd47 is going to be created. [ 621.808670] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.808919] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.809061] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.809364] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.809698] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.810012] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "port-b0e2b15f-7345-4948-a9aa-bf248789fd47" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.811614] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-ed6cda65-baf0-42a6-bcdd-7a946b27c841 taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.811738] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ed6cda65-baf0-42a6-bcdd-7a946b27c841" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.811796] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ed6cda65-baf0-42a6-bcdd-7a946b27c841" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.812017] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ed6cda65-baf0-42a6-bcdd-7a946b27c841" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.812208] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.812305] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.812395] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.812552] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.812686] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.812799] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ed6cda65-baf0-42a6-bcdd-7a946b27c841" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.813295] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-ed6cda65-baf0-42a6-bcdd-7a946b27c841 taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.813295] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ed6cda65-baf0-42a6-bcdd-7a946b27c841" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.813295] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ed6cda65-baf0-42a6-bcdd-7a946b27c841" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.813295] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ed6cda65-baf0-42a6-bcdd-7a946b27c841" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.813581] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.813581] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.813675] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.813816] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.813898] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.813979] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ed6cda65-baf0-42a6-bcdd-7a946b27c841" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.814106] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ed6cda65-baf0-42a6-bcdd-7a946b27c841',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 622.319820] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ed6cda65-baf0-42a6-bcdd-7a946b27c841: rpc.has_security_group_logging(os_id): False [ 622.344343] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.344505] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.344572] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.344796] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.344890] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.345085] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.345184] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.345249] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.345400] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.345637] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.345711] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.345761] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.345790] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.345934] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.345997] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.346195] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.346288] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.346342] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.346902] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.347047] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.347181] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ed6cda65-baf0-42a6-bcdd-7a946b27c841 is going to be created. [ 622.422034] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.424323] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.424323] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.424323] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.424323] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.441622] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ed6cda65-baf0-42a6-bcdd-7a946b27c841 in Status: IN_PROGRESS for 2s [ 622.515905] env[65306]: INFO networking_nsxv3.common.synchronization [req-e0a29617-f34f-4121-a3ce-f972c5027de8 req-f8c8d7ce-ac13-4f3b-994f-ed0be67d84fe service nova] Enqueued Resource ID: 6951f012-9730-40bd-a7af-9b70cd598b05 with Priority: HIGHEST for action security_group_rules [ 622.516643] env[65306]: INFO networking_nsxv3.common.synchronization [req-e0a29617-f34f-4121-a3ce-f972c5027de8 req-f8c8d7ce-ac13-4f3b-994f-ed0be67d84fe service nova] Enqueued Resource ID: 6951f012-9730-40bd-a7af-9b70cd598b05 with Priority: HIGHEST for action security_group_members [ 622.516643] env[65306]: INFO networking_nsxv3.common.synchronization [req-e0a29617-f34f-4121-a3ce-f972c5027de8 req-f8c8d7ce-ac13-4f3b-994f-ed0be67d84fe service nova] Enqueued Resource ID: b0e2b15f-7345-4948-a9aa-bf248789fd47 with Priority: HIGHEST for action port [ 622.517553] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6951f012-9730-40bd-a7af-9b70cd598b05 with Priority: HIGHEST for action security_group_rules [ 622.521042] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6951f012-9730-40bd-a7af-9b70cd598b05 with Priority: HIGHEST for action security_group_members [ 622.521042] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b0e2b15f-7345-4948-a9aa-bf248789fd47 with Priority: HIGHEST for action port [ 622.521042] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6951f012-9730-40bd-a7af-9b70cd598b05 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.521042] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6951f012-9730-40bd-a7af-9b70cd598b05" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.521042] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6951f012-9730-40bd-a7af-9b70cd598b05" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.521042] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6951f012-9730-40bd-a7af-9b70cd598b05" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.521042] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6951f012-9730-40bd-a7af-9b70cd598b05',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 622.521812] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-6951f012-9730-40bd-a7af-9b70cd598b05 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.521812] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6951f012-9730-40bd-a7af-9b70cd598b05" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.521951] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6951f012-9730-40bd-a7af-9b70cd598b05" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.522039] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6951f012-9730-40bd-a7af-9b70cd598b05" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.522568] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.522984] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.522984] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.522984] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.523223] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.523223] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6951f012-9730-40bd-a7af-9b70cd598b05',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 622.524088] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock port-b0e2b15f-7345-4948-a9aa-bf248789fd47 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.524186] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b0e2b15f-7345-4948-a9aa-bf248789fd47" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.524186] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b0e2b15f-7345-4948-a9aa-bf248789fd47" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.524344] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b0e2b15f-7345-4948-a9aa-bf248789fd47" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.524425] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b0e2b15f-7345-4948-a9aa-bf248789fd47',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 622.888279] env[65306]: INFO networking_nsxv3.common.synchronization [None req-23eb1e11-a088-4b3a-802a-dd28938bd55b None None] Enqueued Resource ID: 4802d2f8-786d-4717-a0ae-06bae02e4100 with Priority: HIGHEST for action port [ 622.888279] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4802d2f8-786d-4717-a0ae-06bae02e4100 with Priority: HIGHEST for action port [ 622.888279] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock port-4802d2f8-786d-4717-a0ae-06bae02e4100 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.888491] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4802d2f8-786d-4717-a0ae-06bae02e4100" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.888491] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4802d2f8-786d-4717-a0ae-06bae02e4100" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.888818] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4802d2f8-786d-4717-a0ae-06bae02e4100" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.888943] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4802d2f8-786d-4717-a0ae-06bae02e4100',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 623.029502] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6951f012-9730-40bd-a7af-9b70cd598b05',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 623.029502] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-6951f012-9730-40bd-a7af-9b70cd598b05 taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.029502] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6951f012-9730-40bd-a7af-9b70cd598b05" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.029502] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b0e2b15f-7345-4948-a9aa-bf248789fd47 with status ACTIVE [ 623.029502] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.029502] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.029502] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.029502] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.029502] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.029502] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.030692] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.030892] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.031169] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.031416] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.031715] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.032563] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.032563] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.032563] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.032563] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.032563] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b0e2b15f-7345-4948-a9aa-bf248789fd47 is going to be updated. [ 623.063716] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.063716] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.063716] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.063716] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.063716] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.063716] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b0e2b15f-7345-4948-a9aa-bf248789fd47" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.083284] env[65306]: INFO networking_nsxv3.common.synchronization [req-e0a29617-f34f-4121-a3ce-f972c5027de8 req-72843ce0-d628-43cd-ab41-cf22f49bed38 tempest-ListServersNegativeTestJSON-1230971190 tempest-ListServersNegativeTestJSON-1230971190-project-member] Enqueued Resource ID: 6951f012-9730-40bd-a7af-9b70cd598b05 with Priority: HIGHEST for action security_group_members [ 623.084038] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6951f012-9730-40bd-a7af-9b70cd598b05 with Priority: HIGHEST for action security_group_members [ 623.084138] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-6951f012-9730-40bd-a7af-9b70cd598b05 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.084247] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6951f012-9730-40bd-a7af-9b70cd598b05" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.319584] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 70b8bb37-9445-4339-82b5-ebb24bd0be78 in Status: SUCCESS [ 623.319584] env[65306]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 70b8bb37-9445-4339-82b5-ebb24bd0be78 deletion is rescheduled due to dependency. [ 623.319584] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-70b8bb37-9445-4339-82b5-ebb24bd0be78" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.392026] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4802d2f8-786d-4717-a0ae-06bae02e4100 [ 623.392256] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.392422] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.392516] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.392873] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.392934] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.393091] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4802d2f8-786d-4717-a0ae-06bae02e4100 already deleted. [ 623.393246] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4802d2f8-786d-4717-a0ae-06bae02e4100" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.438569] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock network-823 taken with stack trace [, , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.438569] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "network-823" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.438569] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "network-823" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.438851] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "network-823" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.439254] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.439429] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.439555] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.439800] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.439942] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.440160] env[65306]: DEBUG dogpile.cache.region [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] No value present for key: 'zone-id' {{(pid=65306) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 623.440270] env[65306]: DEBUG dogpile.lock [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] NeedRegenerationException {{(pid=65306) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 623.440376] env[65306]: DEBUG dogpile.lock [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] no value, waiting for create lock {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 623.440481] env[65306]: DEBUG dogpile.lock [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] value creation lock acquired {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 623.440589] env[65306]: DEBUG dogpile.cache.region [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] No value present for key: 'zone-id' {{(pid=65306) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 623.440692] env[65306]: DEBUG dogpile.lock [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Calling creation function for not-yet-present value {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 623.440824] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 623.460844] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 623.462214] env[65306]: DEBUG dogpile.cache.region [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65306) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 623.462214] env[65306]: DEBUG dogpile.lock [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Released creation lock {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 623.462214] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "network-823" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.462214] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock port-35d062c8-4506-42ab-86d1-a678e158a94f taken with stack trace [, , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.462214] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "port-35d062c8-4506-42ab-86d1-a678e158a94f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.462214] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "port-35d062c8-4506-42ab-86d1-a678e158a94f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.462566] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "port-35d062c8-4506-42ab-86d1-a678e158a94f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.462566] env[65306]: DEBUG networking_nsxv3.api.rpc [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('35d062c8-4506-42ab-86d1-a678e158a94f',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 623.535666] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6951f012-9730-40bd-a7af-9b70cd598b05',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 623.712048] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 37349b8b-c2c1-4141-8b10-752c27492cbd in Status: SUCCESS [ 623.712302] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-37349b8b-c2c1-4141-8b10-752c27492cbd" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.712396] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-37349b8b-c2c1-4141-8b10-752c27492cbd" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.712613] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-37349b8b-c2c1-4141-8b10-752c27492cbd" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.712832] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.712955] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.713095] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.713268] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.713414] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.713471] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-37349b8b-c2c1-4141-8b10-752c27492cbd" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.713528] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('37349b8b-c2c1-4141-8b10-752c27492cbd',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 623.965297] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.965514] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.965990] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.965990] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.966124] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.966346] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Segment Port 35d062c8-4506-42ab-86d1-a678e158a94f not found, creating... [ 623.966635] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.966809] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.966944] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.967209] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.967382] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.968837] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.968837] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.968837] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.969556] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.969556] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.969727] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Resource: SegmentPort with ID: 35d062c8-4506-42ab-86d1-a678e158a94f is going to be created. [ 624.021719] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.021719] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.021719] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.021719] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.021719] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.021719] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "port-35d062c8-4506-42ab-86d1-a678e158a94f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.040386] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.040386] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.040386] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.040386] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.040386] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.040386] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6951f012-9730-40bd-a7af-9b70cd598b05 is going to be created. [ 624.079123] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.079123] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.079123] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.079123] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.079123] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.100806] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6951f012-9730-40bd-a7af-9b70cd598b05 in Status: UNINITIALIZED for 2s [ 624.216090] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('37349b8b-c2c1-4141-8b10-752c27492cbd',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 624.457851] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ed6cda65-baf0-42a6-bcdd-7a946b27c841 in Status: SUCCESS [ 624.458260] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ed6cda65-baf0-42a6-bcdd-7a946b27c841" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.719330] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 37349b8b-c2c1-4141-8b10-752c27492cbd: rpc.has_security_group_logging(os_id): False [ 624.739581] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.739732] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.739801] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.740031] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.740113] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.740365] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.740449] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.740533] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.740682] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.741390] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.741390] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 37349b8b-c2c1-4141-8b10-752c27492cbd is going to be created. [ 624.813101] env[65306]: INFO networking_nsxv3.common.synchronization [req-e0a29617-f34f-4121-a3ce-f972c5027de8 req-4f62b9a6-fc22-4219-81d9-4a7bffa9eb69 service nova] Enqueued Resource ID: 6951f012-9730-40bd-a7af-9b70cd598b05 with Priority: HIGHEST for action security_group_rules [ 624.813365] env[65306]: INFO networking_nsxv3.common.synchronization [req-e0a29617-f34f-4121-a3ce-f972c5027de8 req-4f62b9a6-fc22-4219-81d9-4a7bffa9eb69 service nova] Enqueued Resource ID: 6951f012-9730-40bd-a7af-9b70cd598b05 with Priority: HIGHEST for action security_group_members [ 624.813553] env[65306]: INFO networking_nsxv3.common.synchronization [req-e0a29617-f34f-4121-a3ce-f972c5027de8 req-4f62b9a6-fc22-4219-81d9-4a7bffa9eb69 service nova] Enqueued Resource ID: 35d062c8-4506-42ab-86d1-a678e158a94f with Priority: HIGHEST for action port [ 624.814544] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6951f012-9730-40bd-a7af-9b70cd598b05 with Priority: HIGHEST for action security_group_rules [ 624.814742] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6951f012-9730-40bd-a7af-9b70cd598b05 with Priority: HIGHEST for action security_group_members [ 624.814866] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 35d062c8-4506-42ab-86d1-a678e158a94f with Priority: HIGHEST for action port [ 624.815299] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6951f012-9730-40bd-a7af-9b70cd598b05 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.815430] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6951f012-9730-40bd-a7af-9b70cd598b05" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.815711] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-6951f012-9730-40bd-a7af-9b70cd598b05 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.815830] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6951f012-9730-40bd-a7af-9b70cd598b05" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.816104] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock port-35d062c8-4506-42ab-86d1-a678e158a94f taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.816237] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-35d062c8-4506-42ab-86d1-a678e158a94f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.816327] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-35d062c8-4506-42ab-86d1-a678e158a94f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.816858] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-35d062c8-4506-42ab-86d1-a678e158a94f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.816979] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('35d062c8-4506-42ab-86d1-a678e158a94f',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 624.820093] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.820260] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.820353] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.820617] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.820863] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.834917] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 37349b8b-c2c1-4141-8b10-752c27492cbd in Status: IN_PROGRESS for 2s [ 625.319387] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 35d062c8-4506-42ab-86d1-a678e158a94f with status ACTIVE [ 625.319637] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.319812] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.319885] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.320127] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.320215] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.320409] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.320506] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.320573] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.320728] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.321030] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.321180] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.321180] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.321339] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.321441] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.321441] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.321521] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 35d062c8-4506-42ab-86d1-a678e158a94f is going to be updated. [ 625.378852] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.378852] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.378852] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.378852] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.378852] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.378852] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-35d062c8-4506-42ab-86d1-a678e158a94f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.522710] env[65306]: INFO networking_nsxv3.common.synchronization [req-e0a29617-f34f-4121-a3ce-f972c5027de8 req-71b26090-1dbe-4336-9b23-068276ad5460 tempest-ListServersNegativeTestJSON-1230971190 tempest-ListServersNegativeTestJSON-1230971190-project-member] Enqueued Resource ID: 6951f012-9730-40bd-a7af-9b70cd598b05 with Priority: HIGHEST for action security_group_members [ 625.523373] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6951f012-9730-40bd-a7af-9b70cd598b05 with Priority: HIGHEST for action security_group_members [ 625.523700] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-6951f012-9730-40bd-a7af-9b70cd598b05 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.523809] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6951f012-9730-40bd-a7af-9b70cd598b05" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.962415] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock network-823 taken with stack trace [, , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.962667] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "network-823" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.962822] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "network-823" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.963264] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "network-823" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.963534] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.963733] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.963900] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.964171] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.964355] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.964602] env[65306]: DEBUG dogpile.cache.region [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] No value present for key: 'zone-id' {{(pid=65306) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 625.964788] env[65306]: DEBUG dogpile.lock [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] NeedRegenerationException {{(pid=65306) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 625.964901] env[65306]: DEBUG dogpile.lock [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] no value, waiting for create lock {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 625.965075] env[65306]: DEBUG dogpile.lock [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] value creation lock acquired {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 625.965171] env[65306]: DEBUG dogpile.cache.region [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] No value present for key: 'zone-id' {{(pid=65306) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 625.965271] env[65306]: DEBUG dogpile.lock [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Calling creation function for not-yet-present value {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 625.965347] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 625.987310] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 625.987521] env[65306]: DEBUG dogpile.cache.region [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65306) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 625.987723] env[65306]: DEBUG dogpile.lock [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Released creation lock {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 625.988347] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "network-823" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.988347] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock port-dfa6c768-715e-4400-b37c-46da176c5c76 taken with stack trace [, , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.988347] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "port-dfa6c768-715e-4400-b37c-46da176c5c76" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.988792] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "port-dfa6c768-715e-4400-b37c-46da176c5c76" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.988890] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "port-dfa6c768-715e-4400-b37c-46da176c5c76" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.989065] env[65306]: DEBUG networking_nsxv3.api.rpc [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dfa6c768-715e-4400-b37c-46da176c5c76',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 626.111867] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6951f012-9730-40bd-a7af-9b70cd598b05 in Status: SUCCESS [ 626.112106] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6951f012-9730-40bd-a7af-9b70cd598b05" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.112278] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6951f012-9730-40bd-a7af-9b70cd598b05" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.112494] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6951f012-9730-40bd-a7af-9b70cd598b05" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.112741] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.112828] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.112877] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.113050] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.113139] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.113224] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6951f012-9730-40bd-a7af-9b70cd598b05" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.113324] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6951f012-9730-40bd-a7af-9b70cd598b05',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 626.114927] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6951f012-9730-40bd-a7af-9b70cd598b05" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.115537] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6951f012-9730-40bd-a7af-9b70cd598b05" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.115835] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.115986] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.116106] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.116299] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.116407] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.116801] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6951f012-9730-40bd-a7af-9b70cd598b05',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 626.492170] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.492608] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.492841] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.493229] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.493532] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.493710] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Segment Port dfa6c768-715e-4400-b37c-46da176c5c76 not found, creating... [ 626.494042] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.494304] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.494479] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.495157] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.495157] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.495309] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.495587] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.495745] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.496075] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.496280] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.496442] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Resource: SegmentPort with ID: dfa6c768-715e-4400-b37c-46da176c5c76 is going to be created. [ 626.522296] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.522533] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.522701] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.523040] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.523525] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.523625] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "port-dfa6c768-715e-4400-b37c-46da176c5c76" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.615269] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-6951f012-9730-40bd-a7af-9b70cd598b05 taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.615405] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6951f012-9730-40bd-a7af-9b70cd598b05" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.619955] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6951f012-9730-40bd-a7af-9b70cd598b05',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 626.848188] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 37349b8b-c2c1-4141-8b10-752c27492cbd in Status: SUCCESS [ 626.848403] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-37349b8b-c2c1-4141-8b10-752c27492cbd" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.123024] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6951f012-9730-40bd-a7af-9b70cd598b05',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 627.282972] env[65306]: INFO networking_nsxv3.common.synchronization [req-bed20fd0-2f69-4245-9107-eb79d7d7c597 req-a319e6c1-4800-4af5-a430-d65580a7c366 tempest-MultipleCreateTestJSON-2038963662 tempest-MultipleCreateTestJSON-2038963662-project-member] Enqueued Resource ID: df9d38aa-4663-42d9-8451-f5b81969567d with Priority: HIGHEST for action security_group_members [ 627.284347] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: df9d38aa-4663-42d9-8451-f5b81969567d with Priority: HIGHEST for action security_group_members [ 627.284826] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-df9d38aa-4663-42d9-8451-f5b81969567d taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.284894] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-df9d38aa-4663-42d9-8451-f5b81969567d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.284959] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-df9d38aa-4663-42d9-8451-f5b81969567d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.285235] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-df9d38aa-4663-42d9-8451-f5b81969567d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.285396] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.285499] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.285554] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.286011] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.286011] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.286011] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('df9d38aa-4663-42d9-8451-f5b81969567d',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 627.322225] env[65306]: INFO networking_nsxv3.common.synchronization [req-e0a29617-f34f-4121-a3ce-f972c5027de8 req-0e7d0667-bd6f-486d-8e37-46ad30ed48b0 service nova] Enqueued Resource ID: 6951f012-9730-40bd-a7af-9b70cd598b05 with Priority: HIGHEST for action security_group_rules [ 627.322225] env[65306]: INFO networking_nsxv3.common.synchronization [req-e0a29617-f34f-4121-a3ce-f972c5027de8 req-0e7d0667-bd6f-486d-8e37-46ad30ed48b0 service nova] Enqueued Resource ID: 6951f012-9730-40bd-a7af-9b70cd598b05 with Priority: HIGHEST for action security_group_members [ 627.322225] env[65306]: INFO networking_nsxv3.common.synchronization [req-e0a29617-f34f-4121-a3ce-f972c5027de8 req-0e7d0667-bd6f-486d-8e37-46ad30ed48b0 service nova] Enqueued Resource ID: dfa6c768-715e-4400-b37c-46da176c5c76 with Priority: HIGHEST for action port [ 627.322225] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6951f012-9730-40bd-a7af-9b70cd598b05 with Priority: HIGHEST for action security_group_rules [ 627.322225] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6951f012-9730-40bd-a7af-9b70cd598b05 with Priority: HIGHEST for action security_group_members [ 627.322225] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dfa6c768-715e-4400-b37c-46da176c5c76 with Priority: HIGHEST for action port [ 627.323381] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6951f012-9730-40bd-a7af-9b70cd598b05 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.323522] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6951f012-9730-40bd-a7af-9b70cd598b05" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.323789] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-6951f012-9730-40bd-a7af-9b70cd598b05 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.323881] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6951f012-9730-40bd-a7af-9b70cd598b05" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.324088] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock port-dfa6c768-715e-4400-b37c-46da176c5c76 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.325723] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-dfa6c768-715e-4400-b37c-46da176c5c76" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.325723] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-dfa6c768-715e-4400-b37c-46da176c5c76" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.325723] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-dfa6c768-715e-4400-b37c-46da176c5c76" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.325723] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dfa6c768-715e-4400-b37c-46da176c5c76',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 627.625884] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.626354] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.626354] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.626881] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.627900] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.628386] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6951f012-9730-40bd-a7af-9b70cd598b05 is going to be updated. [ 627.671022] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.671022] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.671022] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.671022] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.671022] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.687574] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6951f012-9730-40bd-a7af-9b70cd598b05 in Status: IN_PROGRESS for 2s [ 627.788420] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('df9d38aa-4663-42d9-8451-f5b81969567d',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 627.827367] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port dfa6c768-715e-4400-b37c-46da176c5c76 with status ACTIVE [ 627.827679] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.827997] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.827997] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.828186] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.828297] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.828489] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.828657] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.828738] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.828956] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.829069] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.829246] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.829478] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.829478] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.829760] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.829760] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.829861] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: dfa6c768-715e-4400-b37c-46da176c5c76 is going to be updated. [ 627.872203] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.872360] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.872500] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.872726] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.872813] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.873046] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-dfa6c768-715e-4400-b37c-46da176c5c76" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.295374] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('df9d38aa-4663-42d9-8451-f5b81969567d',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 628.747236] env[65306]: INFO networking_nsxv3.common.synchronization [req-aa0d4571-58e2-4c01-8ad9-b24c038fceb7 req-12a58c5a-24b0-4bac-9819-bad4e05cbb81 tempest-ServerExternalEventsTest-893176434 tempest-ServerExternalEventsTest-893176434-project-member] Enqueued Resource ID: 5188a191-fc4a-4216-b94f-2b854c8abd88 with Priority: HIGHEST for action security_group_members [ 628.750042] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5188a191-fc4a-4216-b94f-2b854c8abd88 with Priority: HIGHEST for action security_group_members [ 628.752390] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-5188a191-fc4a-4216-b94f-2b854c8abd88 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.752811] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5188a191-fc4a-4216-b94f-2b854c8abd88" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.753053] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5188a191-fc4a-4216-b94f-2b854c8abd88" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.753538] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5188a191-fc4a-4216-b94f-2b854c8abd88" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.753933] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.754363] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.754584] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.757499] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.757499] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.757499] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5188a191-fc4a-4216-b94f-2b854c8abd88',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 628.798521] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.798711] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.798813] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.799134] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.799214] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.799340] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: df9d38aa-4663-42d9-8451-f5b81969567d is going to be updated. [ 628.836172] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.836172] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.836172] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.836172] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.836172] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.852719] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: df9d38aa-4663-42d9-8451-f5b81969567d in Status: IN_PROGRESS for 2s [ 629.262305] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.262305] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.262305] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.262305] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.262305] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.262305] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.262305] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.262305] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.262305] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.262305] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.262715] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5188a191-fc4a-4216-b94f-2b854c8abd88 already deleted. [ 629.262715] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5188a191-fc4a-4216-b94f-2b854c8abd88" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.287788] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock network-707 taken with stack trace [, , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.287999] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "network-707" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.288120] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "network-707" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.288382] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "network-707" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.288698] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.288910] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.288967] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.290323] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.292930] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.293193] env[65306]: DEBUG dogpile.cache.region [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] No value present for key: 'zone-id' {{(pid=65306) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 629.293312] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] NeedRegenerationException {{(pid=65306) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 629.293384] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] no value, waiting for create lock {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 629.293493] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] value creation lock acquired {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 629.293629] env[65306]: DEBUG dogpile.cache.region [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] No value present for key: 'zone-id' {{(pid=65306) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 629.294116] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Calling creation function for not-yet-present value {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 629.294116] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 629.352668] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 629.352888] env[65306]: DEBUG dogpile.cache.region [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Cache value generated in 0.059 seconds for key(s): 'zone-id' {{(pid=65306) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 629.353075] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Released creation lock {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 629.353277] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "network-707" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.353609] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock port-703595f6-e563-4f8b-bbbd-604de896f298 taken with stack trace [, , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.353789] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "port-703595f6-e563-4f8b-bbbd-604de896f298" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.353908] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "port-703595f6-e563-4f8b-bbbd-604de896f298" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.354264] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "port-703595f6-e563-4f8b-bbbd-604de896f298" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.354405] env[65306]: DEBUG networking_nsxv3.api.rpc [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('703595f6-e563-4f8b-bbbd-604de896f298',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 629.701083] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6951f012-9730-40bd-a7af-9b70cd598b05 in Status: SUCCESS [ 629.701328] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6951f012-9730-40bd-a7af-9b70cd598b05" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.701511] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6951f012-9730-40bd-a7af-9b70cd598b05" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.701741] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6951f012-9730-40bd-a7af-9b70cd598b05" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.701940] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.702073] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.702142] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.702306] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.702392] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.702509] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6951f012-9730-40bd-a7af-9b70cd598b05',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 629.857740] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.858146] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.858391] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.858901] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.859157] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.859381] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Segment Port 703595f6-e563-4f8b-bbbd-604de896f298 not found, creating... [ 629.859832] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.860103] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.860318] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.860880] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.862392] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.862499] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.862711] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.862957] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.863612] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.863612] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.863741] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Resource: SegmentPort with ID: 703595f6-e563-4f8b-bbbd-604de896f298 is going to be created. [ 629.897952] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.897952] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.897952] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.899477] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.900046] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.901184] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "port-703595f6-e563-4f8b-bbbd-604de896f298" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.204856] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6951f012-9730-40bd-a7af-9b70cd598b05',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 630.601931] env[65306]: INFO networking_nsxv3.common.synchronization [req-aa0d4571-58e2-4c01-8ad9-b24c038fceb7 req-30d4319b-1639-40cd-b385-908a49eefc5f service nova] Enqueued Resource ID: 5188a191-fc4a-4216-b94f-2b854c8abd88 with Priority: HIGHEST for action security_group_rules [ 630.601931] env[65306]: INFO networking_nsxv3.common.synchronization [req-aa0d4571-58e2-4c01-8ad9-b24c038fceb7 req-30d4319b-1639-40cd-b385-908a49eefc5f service nova] Enqueued Resource ID: 5188a191-fc4a-4216-b94f-2b854c8abd88 with Priority: HIGHEST for action security_group_members [ 630.602749] env[65306]: INFO networking_nsxv3.common.synchronization [req-aa0d4571-58e2-4c01-8ad9-b24c038fceb7 req-30d4319b-1639-40cd-b385-908a49eefc5f service nova] Enqueued Resource ID: 703595f6-e563-4f8b-bbbd-604de896f298 with Priority: HIGHEST for action port [ 630.604039] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5188a191-fc4a-4216-b94f-2b854c8abd88 with Priority: HIGHEST for action security_group_rules [ 630.604039] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5188a191-fc4a-4216-b94f-2b854c8abd88 with Priority: HIGHEST for action security_group_members [ 630.604039] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 703595f6-e563-4f8b-bbbd-604de896f298 with Priority: HIGHEST for action port [ 630.604039] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5188a191-fc4a-4216-b94f-2b854c8abd88 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.604039] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5188a191-fc4a-4216-b94f-2b854c8abd88" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.605256] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5188a191-fc4a-4216-b94f-2b854c8abd88" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.605256] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5188a191-fc4a-4216-b94f-2b854c8abd88" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.605256] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5188a191-fc4a-4216-b94f-2b854c8abd88',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 630.607207] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-5188a191-fc4a-4216-b94f-2b854c8abd88 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.607207] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5188a191-fc4a-4216-b94f-2b854c8abd88" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.607207] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5188a191-fc4a-4216-b94f-2b854c8abd88" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.607207] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5188a191-fc4a-4216-b94f-2b854c8abd88" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.607207] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.607207] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.607207] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.607485] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.610145] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.610145] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5188a191-fc4a-4216-b94f-2b854c8abd88',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 630.610145] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock port-703595f6-e563-4f8b-bbbd-604de896f298 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.610145] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-703595f6-e563-4f8b-bbbd-604de896f298" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.610145] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-703595f6-e563-4f8b-bbbd-604de896f298" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.610145] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-703595f6-e563-4f8b-bbbd-604de896f298" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.610145] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('703595f6-e563-4f8b-bbbd-604de896f298',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 630.656496] env[65306]: INFO networking_nsxv3.common.synchronization [req-4844f951-83a8-4d17-88b5-05246c21a380 req-f9501192-d65b-4227-806f-ccbf953c6470 tempest-MultipleCreateTestJSON-2038963662 tempest-MultipleCreateTestJSON-2038963662-project-member] Enqueued Resource ID: df9d38aa-4663-42d9-8451-f5b81969567d with Priority: HIGHEST for action security_group_members [ 630.657469] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: df9d38aa-4663-42d9-8451-f5b81969567d with Priority: HIGHEST for action security_group_members [ 630.657760] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-df9d38aa-4663-42d9-8451-f5b81969567d taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.657760] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-df9d38aa-4663-42d9-8451-f5b81969567d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.706908] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6951f012-9730-40bd-a7af-9b70cd598b05',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 630.865681] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: df9d38aa-4663-42d9-8451-f5b81969567d in Status: SUCCESS [ 630.866880] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-df9d38aa-4663-42d9-8451-f5b81969567d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.866880] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-df9d38aa-4663-42d9-8451-f5b81969567d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.866880] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-df9d38aa-4663-42d9-8451-f5b81969567d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.866880] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.867175] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.867175] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.867915] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.867915] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.867915] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('df9d38aa-4663-42d9-8451-f5b81969567d',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 631.111275] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-5188a191-fc4a-4216-b94f-2b854c8abd88 taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.112102] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5188a191-fc4a-4216-b94f-2b854c8abd88" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.112102] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5188a191-fc4a-4216-b94f-2b854c8abd88',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 631.113133] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 703595f6-e563-4f8b-bbbd-604de896f298 with status ACTIVE [ 631.113270] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.113425] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.113552] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.113982] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.113982] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.114080] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.114996] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.114996] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.114996] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.114996] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.115371] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.115537] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.115739] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.115996] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.116144] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.116270] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 703595f6-e563-4f8b-bbbd-604de896f298 is going to be updated. [ 631.143134] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.143684] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.143684] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.143954] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.144572] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.144795] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-703595f6-e563-4f8b-bbbd-604de896f298" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.209115] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.210065] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.210207] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.210434] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.210554] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.210628] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6951f012-9730-40bd-a7af-9b70cd598b05 is going to be updated. [ 631.290266] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.290433] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.290517] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.290710] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.290858] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.302721] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6951f012-9730-40bd-a7af-9b70cd598b05 in Status: IN_PROGRESS for 2s [ 631.373708] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.373708] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.373708] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.373708] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.373708] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.373708] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.373708] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.373708] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.373708] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.373708] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.373708] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: df9d38aa-4663-42d9-8451-f5b81969567d is going to be updated. [ 631.408168] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.408168] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.408168] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.408168] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.408168] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.423954] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: df9d38aa-4663-42d9-8451-f5b81969567d in Status: IN_PROGRESS for 2s [ 631.619555] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5188a191-fc4a-4216-b94f-2b854c8abd88',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 632.126222] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.126222] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.126222] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.126222] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.126222] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.126222] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5188a191-fc4a-4216-b94f-2b854c8abd88 is going to be created. [ 632.152821] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.152821] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.152821] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.152821] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.153806] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.167592] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5188a191-fc4a-4216-b94f-2b854c8abd88 in Status: UNINITIALIZED for 2s [ 632.561946] env[65306]: INFO networking_nsxv3.common.synchronization [None req-ba76fd92-41bc-45ff-9e88-0ad53cc1affe None None] Enqueued Resource ID: 4d292e48-dc9b-49c4-bef8-096e94f78501 with Priority: HIGHEST for action port [ 632.562232] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4d292e48-dc9b-49c4-bef8-096e94f78501 with Priority: HIGHEST for action port [ 632.562806] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock port-4d292e48-dc9b-49c4-bef8-096e94f78501 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.562927] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4d292e48-dc9b-49c4-bef8-096e94f78501" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.562997] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4d292e48-dc9b-49c4-bef8-096e94f78501" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.563273] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4d292e48-dc9b-49c4-bef8-096e94f78501" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.563360] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4d292e48-dc9b-49c4-bef8-096e94f78501',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 633.066034] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4d292e48-dc9b-49c4-bef8-096e94f78501 [ 633.066273] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.066453] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.066586] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.066925] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.067046] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.067155] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4d292e48-dc9b-49c4-bef8-096e94f78501 already deleted. [ 633.067242] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4d292e48-dc9b-49c4-bef8-096e94f78501" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.316040] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6951f012-9730-40bd-a7af-9b70cd598b05 in Status: SUCCESS [ 633.316040] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6951f012-9730-40bd-a7af-9b70cd598b05" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.316040] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6951f012-9730-40bd-a7af-9b70cd598b05" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.316040] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6951f012-9730-40bd-a7af-9b70cd598b05" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.316040] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.316986] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.316986] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.316986] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.316986] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.316986] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6951f012-9730-40bd-a7af-9b70cd598b05',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 633.435479] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: df9d38aa-4663-42d9-8451-f5b81969567d in Status: SUCCESS [ 633.435664] env[65306]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: df9d38aa-4663-42d9-8451-f5b81969567d deletion is rescheduled due to dependency. [ 633.435837] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-df9d38aa-4663-42d9-8451-f5b81969567d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.534822] env[65306]: INFO networking_nsxv3.common.synchronization [None req-8491e02c-fa65-497b-9fdd-25e7f440004c None None] Enqueued Resource ID: 8b8cd35d-5667-46e0-ae9d-67bb17eb2926 with Priority: HIGHEST for action port [ 633.534822] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8b8cd35d-5667-46e0-ae9d-67bb17eb2926 with Priority: HIGHEST for action port [ 633.535031] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock port-8b8cd35d-5667-46e0-ae9d-67bb17eb2926 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.535176] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8b8cd35d-5667-46e0-ae9d-67bb17eb2926" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.535244] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8b8cd35d-5667-46e0-ae9d-67bb17eb2926" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.535475] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8b8cd35d-5667-46e0-ae9d-67bb17eb2926" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.535562] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8b8cd35d-5667-46e0-ae9d-67bb17eb2926',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 633.819520] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6951f012-9730-40bd-a7af-9b70cd598b05',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 634.018613] env[65306]: INFO networking_nsxv3.common.synchronization [req-82459030-bec7-4afb-928a-63f2efc58644 req-e0ce4d5d-ded5-45be-84d6-21f13163a40f tempest-ServersAdminNegativeTestJSON-1507119040 tempest-ServersAdminNegativeTestJSON-1507119040-project-member] Enqueued Resource ID: e3e0f6b2-2984-4938-adcc-0374a714ff76 with Priority: HIGHEST for action security_group_members [ 634.019886] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e3e0f6b2-2984-4938-adcc-0374a714ff76 with Priority: HIGHEST for action security_group_members [ 634.019886] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-e3e0f6b2-2984-4938-adcc-0374a714ff76 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.019886] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e3e0f6b2-2984-4938-adcc-0374a714ff76" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.019886] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e3e0f6b2-2984-4938-adcc-0374a714ff76" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.019886] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e3e0f6b2-2984-4938-adcc-0374a714ff76" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.020080] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.020754] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.020754] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.020754] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.020754] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.020754] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e3e0f6b2-2984-4938-adcc-0374a714ff76',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 634.042035] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8b8cd35d-5667-46e0-ae9d-67bb17eb2926 [ 634.042035] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.042035] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.042035] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.042490] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.042490] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.042490] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8b8cd35d-5667-46e0-ae9d-67bb17eb2926 already deleted. [ 634.042613] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8b8cd35d-5667-46e0-ae9d-67bb17eb2926" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.180026] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5188a191-fc4a-4216-b94f-2b854c8abd88 in Status: SUCCESS [ 634.180428] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5188a191-fc4a-4216-b94f-2b854c8abd88" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.180428] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5188a191-fc4a-4216-b94f-2b854c8abd88" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.180703] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5188a191-fc4a-4216-b94f-2b854c8abd88" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.180840] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.181073] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.181142] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.181690] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.181690] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.181690] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5188a191-fc4a-4216-b94f-2b854c8abd88" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.181690] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5188a191-fc4a-4216-b94f-2b854c8abd88',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 634.325702] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6951f012-9730-40bd-a7af-9b70cd598b05',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 634.416105] env[65306]: INFO networking_nsxv3.common.synchronization [None req-b07cb195-cfa5-4b33-82ac-afa6348c0b6f None None] Enqueued Resource ID: 2df932e8-23a7-4172-a34e-250cc7f48c65 with Priority: HIGHEST for action port [ 634.416246] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2df932e8-23a7-4172-a34e-250cc7f48c65 with Priority: HIGHEST for action port [ 634.416639] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock port-2df932e8-23a7-4172-a34e-250cc7f48c65 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.416835] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2df932e8-23a7-4172-a34e-250cc7f48c65" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.416958] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2df932e8-23a7-4172-a34e-250cc7f48c65" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.417297] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2df932e8-23a7-4172-a34e-250cc7f48c65" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.417446] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2df932e8-23a7-4172-a34e-250cc7f48c65',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 634.495704] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock network-707 taken with stack trace [, , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.495894] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "network-707" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.496021] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "network-707" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.497034] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "network-707" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.497034] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.497241] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.497297] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.497509] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.497649] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.498644] env[65306]: DEBUG dogpile.cache.region [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] No value present for key: 'zone-id' {{(pid=65306) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 634.498644] env[65306]: DEBUG dogpile.lock [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] NeedRegenerationException {{(pid=65306) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 634.498644] env[65306]: DEBUG dogpile.lock [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] no value, waiting for create lock {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 634.498644] env[65306]: DEBUG dogpile.lock [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] value creation lock acquired {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 634.498644] env[65306]: DEBUG dogpile.cache.region [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] No value present for key: 'zone-id' {{(pid=65306) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 634.498644] env[65306]: DEBUG dogpile.lock [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Calling creation function for not-yet-present value {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 634.498644] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 634.525049] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 634.525314] env[65306]: DEBUG dogpile.cache.region [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=65306) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 634.525553] env[65306]: DEBUG dogpile.lock [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Released creation lock {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 634.525966] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "network-707" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.526397] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock port-5d43e2b2-f769-4c4f-b736-aa8d82c4fdcc taken with stack trace [, , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.526774] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "port-5d43e2b2-f769-4c4f-b736-aa8d82c4fdcc" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.526774] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "port-5d43e2b2-f769-4c4f-b736-aa8d82c4fdcc" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.528420] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "port-5d43e2b2-f769-4c4f-b736-aa8d82c4fdcc" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.528420] env[65306]: DEBUG networking_nsxv3.api.rpc [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5d43e2b2-f769-4c4f-b736-aa8d82c4fdcc',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 634.531313] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e3e0f6b2-2984-4938-adcc-0374a714ff76',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 634.688051] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-5188a191-fc4a-4216-b94f-2b854c8abd88 taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.688261] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5188a191-fc4a-4216-b94f-2b854c8abd88" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.688261] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5188a191-fc4a-4216-b94f-2b854c8abd88" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.689108] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5188a191-fc4a-4216-b94f-2b854c8abd88" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.689108] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.689108] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.689108] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.689108] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.689108] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.689569] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5188a191-fc4a-4216-b94f-2b854c8abd88" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.689569] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-5188a191-fc4a-4216-b94f-2b854c8abd88 taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.689569] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5188a191-fc4a-4216-b94f-2b854c8abd88" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.689569] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5188a191-fc4a-4216-b94f-2b854c8abd88" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.689977] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5188a191-fc4a-4216-b94f-2b854c8abd88" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.689977] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.689977] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.690125] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.690167] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.690247] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.690332] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5188a191-fc4a-4216-b94f-2b854c8abd88" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.690433] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5188a191-fc4a-4216-b94f-2b854c8abd88',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 634.829571] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.829768] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.829850] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.830127] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.830224] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.830342] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6951f012-9730-40bd-a7af-9b70cd598b05 is going to be updated. [ 634.863614] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.863801] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.863872] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.864094] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.864247] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.881046] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6951f012-9730-40bd-a7af-9b70cd598b05 in Status: IN_PROGRESS for 2s [ 634.921021] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2df932e8-23a7-4172-a34e-250cc7f48c65 [ 634.921223] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.921423] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.921423] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.921686] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.921817] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.921926] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2df932e8-23a7-4172-a34e-250cc7f48c65 already deleted. [ 634.922307] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2df932e8-23a7-4172-a34e-250cc7f48c65" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.034779] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.035367] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.035367] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.035639] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.035731] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.035884] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Segment Port 5d43e2b2-f769-4c4f-b736-aa8d82c4fdcc not found, creating... [ 635.036192] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.036383] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.036502] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.036766] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.036921] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.037479] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.037607] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.037768] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.038634] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.038634] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.038634] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Resource: SegmentPort with ID: 5d43e2b2-f769-4c4f-b736-aa8d82c4fdcc is going to be created. [ 635.039830] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e3e0f6b2-2984-4938-adcc-0374a714ff76',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 635.065597] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.065861] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.065944] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.066204] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.066427] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.066655] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "port-5d43e2b2-f769-4c4f-b736-aa8d82c4fdcc" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.194646] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5188a191-fc4a-4216-b94f-2b854c8abd88: rpc.has_security_group_logging(os_id): False [ 635.217905] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.218133] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.218368] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.218368] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.218510] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.218730] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.218852] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.218852] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.219221] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.219221] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.219296] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.219444] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.219444] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.219653] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.220137] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.220137] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.220137] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.220137] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.221422] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.221422] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.221422] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5188a191-fc4a-4216-b94f-2b854c8abd88 is going to be created. [ 635.349141] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.349487] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.349487] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.349487] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.349704] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.367879] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5188a191-fc4a-4216-b94f-2b854c8abd88 in Status: IN_PROGRESS for 2s [ 635.544073] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.544073] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.544073] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.544073] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.544073] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.544073] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e3e0f6b2-2984-4938-adcc-0374a714ff76 is going to be updated. [ 635.582937] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.583283] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.583666] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.585750] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.585750] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.600164] env[65306]: INFO networking_nsxv3.common.synchronization [None req-37d343fc-1aad-47cc-9826-3692cb2904a1 None None] Enqueued Resource ID: 43023ecd-110c-4853-a693-475051f6bb33 with Priority: HIGHEST for action port [ 635.600788] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 43023ecd-110c-4853-a693-475051f6bb33 with Priority: HIGHEST for action port [ 635.603366] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock port-43023ecd-110c-4853-a693-475051f6bb33 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.603366] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-43023ecd-110c-4853-a693-475051f6bb33" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.603366] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-43023ecd-110c-4853-a693-475051f6bb33" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.603366] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-43023ecd-110c-4853-a693-475051f6bb33" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.603366] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('43023ecd-110c-4853-a693-475051f6bb33',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 635.605132] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e3e0f6b2-2984-4938-adcc-0374a714ff76 in Status: IN_PROGRESS for 2s [ 635.913078] env[65306]: INFO networking_nsxv3.common.synchronization [req-b2f60e79-182c-4c46-a001-47a2a89d0e46 req-a839e85c-b58f-4bf3-bb55-00e019ac00d0 tempest-ServersWithSpecificFlavorTestJSON-1706838422 tempest-ServersWithSpecificFlavorTestJSON-1706838422-project-member] Enqueued Resource ID: ef5de9e7-0c3b-4386-af3c-de134eff75f3 with Priority: HIGHEST for action security_group_members [ 635.913078] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ef5de9e7-0c3b-4386-af3c-de134eff75f3 with Priority: HIGHEST for action security_group_members [ 635.913078] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-ef5de9e7-0c3b-4386-af3c-de134eff75f3 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.913078] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ef5de9e7-0c3b-4386-af3c-de134eff75f3" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.913078] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ef5de9e7-0c3b-4386-af3c-de134eff75f3" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.913381] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ef5de9e7-0c3b-4386-af3c-de134eff75f3" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.914048] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.914048] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.914048] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.914048] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.914048] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.914048] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ef5de9e7-0c3b-4386-af3c-de134eff75f3',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 636.055244] env[65306]: INFO networking_nsxv3.common.synchronization [req-82459030-bec7-4afb-928a-63f2efc58644 req-70399d48-1e8b-40e9-bf97-4119b2ed8dfa service nova] Enqueued Resource ID: e3e0f6b2-2984-4938-adcc-0374a714ff76 with Priority: HIGHEST for action security_group_rules [ 636.055481] env[65306]: INFO networking_nsxv3.common.synchronization [req-82459030-bec7-4afb-928a-63f2efc58644 req-70399d48-1e8b-40e9-bf97-4119b2ed8dfa service nova] Enqueued Resource ID: e3e0f6b2-2984-4938-adcc-0374a714ff76 with Priority: HIGHEST for action security_group_members [ 636.055887] env[65306]: INFO networking_nsxv3.common.synchronization [req-82459030-bec7-4afb-928a-63f2efc58644 req-70399d48-1e8b-40e9-bf97-4119b2ed8dfa service nova] Enqueued Resource ID: 5d43e2b2-f769-4c4f-b736-aa8d82c4fdcc with Priority: HIGHEST for action port [ 636.056827] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e3e0f6b2-2984-4938-adcc-0374a714ff76 with Priority: HIGHEST for action security_group_rules [ 636.057509] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e3e0f6b2-2984-4938-adcc-0374a714ff76 with Priority: HIGHEST for action security_group_members [ 636.057611] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5d43e2b2-f769-4c4f-b736-aa8d82c4fdcc with Priority: HIGHEST for action port [ 636.058650] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e3e0f6b2-2984-4938-adcc-0374a714ff76 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.058650] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e3e0f6b2-2984-4938-adcc-0374a714ff76" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.058650] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e3e0f6b2-2984-4938-adcc-0374a714ff76" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.058650] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e3e0f6b2-2984-4938-adcc-0374a714ff76" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.058650] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e3e0f6b2-2984-4938-adcc-0374a714ff76',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 636.060916] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-e3e0f6b2-2984-4938-adcc-0374a714ff76 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.061910] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e3e0f6b2-2984-4938-adcc-0374a714ff76" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.061910] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock port-5d43e2b2-f769-4c4f-b736-aa8d82c4fdcc taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.061910] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5d43e2b2-f769-4c4f-b736-aa8d82c4fdcc" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.061910] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5d43e2b2-f769-4c4f-b736-aa8d82c4fdcc" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.062214] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5d43e2b2-f769-4c4f-b736-aa8d82c4fdcc" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.062214] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5d43e2b2-f769-4c4f-b736-aa8d82c4fdcc',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 636.107860] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 43023ecd-110c-4853-a693-475051f6bb33 [ 636.107860] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.107860] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.107860] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.107860] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.107860] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.107860] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:43023ecd-110c-4853-a693-475051f6bb33 already deleted. [ 636.107860] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-43023ecd-110c-4853-a693-475051f6bb33" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.417232] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.417568] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.417568] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.417972] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.418103] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.418272] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.418389] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.418450] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.418577] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.418654] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.418782] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ef5de9e7-0c3b-4386-af3c-de134eff75f3 already deleted. [ 636.418869] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ef5de9e7-0c3b-4386-af3c-de134eff75f3" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.437374] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock network-35 taken with stack trace [, , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.437374] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "network-35" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.437374] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "network-35" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.437793] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "network-35" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.438062] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.438228] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.438341] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.438563] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.438798] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.439026] env[65306]: DEBUG dogpile.cache.region [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] No value present for key: 'zone-id' {{(pid=65306) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 636.439150] env[65306]: DEBUG dogpile.lock [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] NeedRegenerationException {{(pid=65306) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 636.439324] env[65306]: DEBUG dogpile.lock [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] no value, waiting for create lock {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 636.439432] env[65306]: DEBUG dogpile.lock [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] value creation lock acquired {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 636.439541] env[65306]: DEBUG dogpile.cache.region [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] No value present for key: 'zone-id' {{(pid=65306) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 636.439641] env[65306]: DEBUG dogpile.lock [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Calling creation function for not-yet-present value {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 636.439784] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 636.460805] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 636.460999] env[65306]: DEBUG dogpile.cache.region [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65306) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 636.461164] env[65306]: DEBUG dogpile.lock [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Released creation lock {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 636.461357] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "network-35" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.461691] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock port-04452d64-9fe1-47f9-a443-14bee4f28c10 taken with stack trace [, , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.461865] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "port-04452d64-9fe1-47f9-a443-14bee4f28c10" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.461967] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "port-04452d64-9fe1-47f9-a443-14bee4f28c10" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.462310] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "port-04452d64-9fe1-47f9-a443-14bee4f28c10" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.462440] env[65306]: DEBUG networking_nsxv3.api.rpc [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('04452d64-9fe1-47f9-a443-14bee4f28c10',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 636.564127] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-e3e0f6b2-2984-4938-adcc-0374a714ff76 taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.564127] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e3e0f6b2-2984-4938-adcc-0374a714ff76" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.564894] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5d43e2b2-f769-4c4f-b736-aa8d82c4fdcc with status ACTIVE [ 636.564894] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.564894] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.564894] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.565170] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.565253] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.566175] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.566175] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.566175] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.566175] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.566175] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.566356] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.566701] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.566765] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.567463] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.567463] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.567463] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5d43e2b2-f769-4c4f-b736-aa8d82c4fdcc is going to be updated. [ 636.614954] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.614954] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.614954] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.614954] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.614954] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.614954] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5d43e2b2-f769-4c4f-b736-aa8d82c4fdcc" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.894716] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6951f012-9730-40bd-a7af-9b70cd598b05 in Status: SUCCESS [ 636.895073] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6951f012-9730-40bd-a7af-9b70cd598b05" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.895339] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6951f012-9730-40bd-a7af-9b70cd598b05" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.895652] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6951f012-9730-40bd-a7af-9b70cd598b05" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.896079] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.896182] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.896277] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.896534] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.896668] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.896802] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6951f012-9730-40bd-a7af-9b70cd598b05" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.897632] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-6951f012-9730-40bd-a7af-9b70cd598b05 taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.898494] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6951f012-9730-40bd-a7af-9b70cd598b05" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.898621] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6951f012-9730-40bd-a7af-9b70cd598b05" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.899224] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6951f012-9730-40bd-a7af-9b70cd598b05" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.899474] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.899740] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.899740] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.900682] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.900682] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.900682] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6951f012-9730-40bd-a7af-9b70cd598b05" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.900682] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6951f012-9730-40bd-a7af-9b70cd598b05',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 636.901418] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6951f012-9730-40bd-a7af-9b70cd598b05" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.901595] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6951f012-9730-40bd-a7af-9b70cd598b05" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.901921] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.901921] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.902075] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.902180] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.902257] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.902349] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6951f012-9730-40bd-a7af-9b70cd598b05',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 636.922682] env[65306]: INFO networking_nsxv3.common.synchronization [None req-7e0b4791-f1ec-4c81-b336-45002d6dade7 None None] Enqueued Resource ID: 18d15d0e-91b8-4570-a0fd-5d3eb7b0cc5f with Priority: HIGHEST for action port [ 636.926660] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 18d15d0e-91b8-4570-a0fd-5d3eb7b0cc5f with Priority: HIGHEST for action port [ 636.926660] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock port-18d15d0e-91b8-4570-a0fd-5d3eb7b0cc5f taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.926660] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-18d15d0e-91b8-4570-a0fd-5d3eb7b0cc5f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.926660] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-18d15d0e-91b8-4570-a0fd-5d3eb7b0cc5f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.926660] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-18d15d0e-91b8-4570-a0fd-5d3eb7b0cc5f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.926660] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('18d15d0e-91b8-4570-a0fd-5d3eb7b0cc5f',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 636.965542] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.965542] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.965714] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.965954] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.966138] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.966324] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Segment Port 04452d64-9fe1-47f9-a443-14bee4f28c10 not found, creating... [ 636.966697] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.966830] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.966941] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.967145] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.967320] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.967621] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.968100] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.968100] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.968301] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.968451] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.968653] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Resource: SegmentPort with ID: 04452d64-9fe1-47f9-a443-14bee4f28c10 is going to be created. [ 636.995147] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.995147] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.995147] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.995147] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.995147] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.995147] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "port-04452d64-9fe1-47f9-a443-14bee4f28c10" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.169597] env[65306]: INFO networking_nsxv3.common.synchronization [None req-2c9fc10a-1ac0-4e27-97fd-bae0ead1e74c None None] Enqueued Resource ID: b4194ea7-6bf5-4d2d-a29d-26d717f7efb7 with Priority: HIGHEST for action port [ 637.170176] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b4194ea7-6bf5-4d2d-a29d-26d717f7efb7 with Priority: HIGHEST for action port [ 637.170572] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock port-b4194ea7-6bf5-4d2d-a29d-26d717f7efb7 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.170694] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b4194ea7-6bf5-4d2d-a29d-26d717f7efb7" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.170694] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b4194ea7-6bf5-4d2d-a29d-26d717f7efb7" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.170988] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b4194ea7-6bf5-4d2d-a29d-26d717f7efb7" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.171963] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b4194ea7-6bf5-4d2d-a29d-26d717f7efb7',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 637.389642] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5188a191-fc4a-4216-b94f-2b854c8abd88 in Status: SUCCESS [ 637.389894] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5188a191-fc4a-4216-b94f-2b854c8abd88" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.404419] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6951f012-9730-40bd-a7af-9b70cd598b05: rpc.has_security_group_logging(os_id): False [ 637.405534] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6951f012-9730-40bd-a7af-9b70cd598b05',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 637.424278] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.424596] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.424596] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.424900] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.425048] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.425191] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.425283] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.425430] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.425585] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.425585] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.426184] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.426184] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.426184] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.426184] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.426184] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.426582] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.426582] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.426582] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.426747] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.426747] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.426841] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6951f012-9730-40bd-a7af-9b70cd598b05 is going to be created. [ 637.427958] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 18d15d0e-91b8-4570-a0fd-5d3eb7b0cc5f [ 637.428132] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.428235] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.428295] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.428444] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.428525] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.429484] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:18d15d0e-91b8-4570-a0fd-5d3eb7b0cc5f already deleted. [ 637.429484] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-18d15d0e-91b8-4570-a0fd-5d3eb7b0cc5f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.500468] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.500560] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.500648] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.500883] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.501184] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.516060] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6951f012-9730-40bd-a7af-9b70cd598b05 in Status: IN_PROGRESS for 2s [ 637.618449] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e3e0f6b2-2984-4938-adcc-0374a714ff76 in Status: SUCCESS [ 637.618842] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e3e0f6b2-2984-4938-adcc-0374a714ff76" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.619207] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e3e0f6b2-2984-4938-adcc-0374a714ff76" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.620446] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e3e0f6b2-2984-4938-adcc-0374a714ff76" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.620446] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.620446] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.620446] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.620446] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.620446] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.620446] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e3e0f6b2-2984-4938-adcc-0374a714ff76',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 637.673951] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b4194ea7-6bf5-4d2d-a29d-26d717f7efb7 [ 637.674203] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.674339] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.674412] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.674620] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.676343] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.676343] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b4194ea7-6bf5-4d2d-a29d-26d717f7efb7 already deleted. [ 637.676343] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b4194ea7-6bf5-4d2d-a29d-26d717f7efb7" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.756670] env[65306]: INFO networking_nsxv3.common.synchronization [req-b2f60e79-182c-4c46-a001-47a2a89d0e46 req-c61c3d24-04e6-444f-bf5c-83fe6f42b122 service nova] Enqueued Resource ID: ef5de9e7-0c3b-4386-af3c-de134eff75f3 with Priority: HIGHEST for action security_group_rules [ 637.756804] env[65306]: INFO networking_nsxv3.common.synchronization [req-b2f60e79-182c-4c46-a001-47a2a89d0e46 req-c61c3d24-04e6-444f-bf5c-83fe6f42b122 service nova] Enqueued Resource ID: ef5de9e7-0c3b-4386-af3c-de134eff75f3 with Priority: HIGHEST for action security_group_members [ 637.756944] env[65306]: INFO networking_nsxv3.common.synchronization [req-b2f60e79-182c-4c46-a001-47a2a89d0e46 req-c61c3d24-04e6-444f-bf5c-83fe6f42b122 service nova] Enqueued Resource ID: 04452d64-9fe1-47f9-a443-14bee4f28c10 with Priority: HIGHEST for action port [ 637.758684] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ef5de9e7-0c3b-4386-af3c-de134eff75f3 with Priority: HIGHEST for action security_group_rules [ 637.758684] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ef5de9e7-0c3b-4386-af3c-de134eff75f3 with Priority: HIGHEST for action security_group_members [ 637.758684] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 04452d64-9fe1-47f9-a443-14bee4f28c10 with Priority: HIGHEST for action port [ 637.758684] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ef5de9e7-0c3b-4386-af3c-de134eff75f3 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.758684] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ef5de9e7-0c3b-4386-af3c-de134eff75f3" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.758684] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ef5de9e7-0c3b-4386-af3c-de134eff75f3" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.758684] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ef5de9e7-0c3b-4386-af3c-de134eff75f3" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.758684] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ef5de9e7-0c3b-4386-af3c-de134eff75f3',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 637.759867] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-ef5de9e7-0c3b-4386-af3c-de134eff75f3 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.759867] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ef5de9e7-0c3b-4386-af3c-de134eff75f3" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.759867] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ef5de9e7-0c3b-4386-af3c-de134eff75f3" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.759867] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ef5de9e7-0c3b-4386-af3c-de134eff75f3" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.759867] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.760275] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.760275] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.760275] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.760275] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.760449] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ef5de9e7-0c3b-4386-af3c-de134eff75f3',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 637.761145] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock port-04452d64-9fe1-47f9-a443-14bee4f28c10 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.761260] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-04452d64-9fe1-47f9-a443-14bee4f28c10" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.761326] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-04452d64-9fe1-47f9-a443-14bee4f28c10" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.761478] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-04452d64-9fe1-47f9-a443-14bee4f28c10" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.761552] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('04452d64-9fe1-47f9-a443-14bee4f28c10',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 637.908371] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6951f012-9730-40bd-a7af-9b70cd598b05',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 638.127397] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e3e0f6b2-2984-4938-adcc-0374a714ff76',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 638.264969] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-ef5de9e7-0c3b-4386-af3c-de134eff75f3 taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.265229] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ef5de9e7-0c3b-4386-af3c-de134eff75f3" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.267023] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 04452d64-9fe1-47f9-a443-14bee4f28c10 with status ACTIVE [ 638.267023] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.267023] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.267023] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.267023] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.267023] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.267023] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.267023] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.267023] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.267582] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.267582] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.267582] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.267694] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.267874] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.276253] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.276518] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.276743] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 04452d64-9fe1-47f9-a443-14bee4f28c10 is going to be updated. [ 638.278550] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ef5de9e7-0c3b-4386-af3c-de134eff75f3',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 638.310377] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.310377] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.310614] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.310653] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.311791] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.311791] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-04452d64-9fe1-47f9-a443-14bee4f28c10" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.411374] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.411562] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.411609] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.412335] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.412335] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.412335] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6951f012-9730-40bd-a7af-9b70cd598b05 is going to be updated. [ 638.454271] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.454683] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.454683] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.454770] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.454950] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.467371] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6951f012-9730-40bd-a7af-9b70cd598b05 in Status: IN_PROGRESS for 2s [ 638.630690] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e3e0f6b2-2984-4938-adcc-0374a714ff76',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 638.783241] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ef5de9e7-0c3b-4386-af3c-de134eff75f3',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 639.133164] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.133164] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.133355] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.133420] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.134642] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.134642] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e3e0f6b2-2984-4938-adcc-0374a714ff76 is going to be updated. [ 639.169664] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.169955] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.169955] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.170317] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.170364] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.186553] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e3e0f6b2-2984-4938-adcc-0374a714ff76 in Status: IN_PROGRESS for 2s [ 639.288932] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.289072] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.289179] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.289373] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.289488] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.289600] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ef5de9e7-0c3b-4386-af3c-de134eff75f3 is going to be created. [ 639.313295] env[65306]: INFO networking_nsxv3.common.synchronization [req-ea6f03de-6aaf-410b-9593-5584fcb48240 req-98485108-64e3-4875-82f0-566e454661e6 tempest-ServerMetadataNegativeTestJSON-1997240022 tempest-ServerMetadataNegativeTestJSON-1997240022-project-member] Enqueued Resource ID: 55a6ae08-0730-4d04-bc2c-3f0c36758315 with Priority: HIGHEST for action security_group_members [ 639.314942] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 55a6ae08-0730-4d04-bc2c-3f0c36758315 with Priority: HIGHEST for action security_group_members [ 639.314942] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-55a6ae08-0730-4d04-bc2c-3f0c36758315 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.314942] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-55a6ae08-0730-4d04-bc2c-3f0c36758315" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.315840] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-55a6ae08-0730-4d04-bc2c-3f0c36758315" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.316440] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-55a6ae08-0730-4d04-bc2c-3f0c36758315" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.317568] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.317568] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.317568] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.317750] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.317784] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.317881] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('55a6ae08-0730-4d04-bc2c-3f0c36758315',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 639.326628] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.326628] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.326628] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.326628] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.326628] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.342791] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ef5de9e7-0c3b-4386-af3c-de134eff75f3 in Status: UNINITIALIZED for 2s [ 639.528432] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6951f012-9730-40bd-a7af-9b70cd598b05 in Status: SUCCESS [ 639.529163] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6951f012-9730-40bd-a7af-9b70cd598b05" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.530332] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6951f012-9730-40bd-a7af-9b70cd598b05" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.530591] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6951f012-9730-40bd-a7af-9b70cd598b05" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.530692] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6951f012-9730-40bd-a7af-9b70cd598b05',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 639.782106] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock network-457 taken with stack trace [, , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.782106] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "network-457" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.782106] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "network-457" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.782106] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "network-457" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.782106] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.782106] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.782106] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.782805] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.783029] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.783255] env[65306]: DEBUG dogpile.cache.region [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] No value present for key: 'zone-id' {{(pid=65306) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 639.783367] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] NeedRegenerationException {{(pid=65306) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 639.783470] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] no value, waiting for create lock {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 639.783568] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] value creation lock acquired {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 639.783672] env[65306]: DEBUG dogpile.cache.region [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] No value present for key: 'zone-id' {{(pid=65306) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 639.783770] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Calling creation function for not-yet-present value {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 639.783977] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 639.810589] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 639.810750] env[65306]: DEBUG dogpile.cache.region [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=65306) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 639.811010] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Released creation lock {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 639.811085] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "network-457" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.811392] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock port-0fd0e9d9-5a64-4532-a1ea-27b2489bdf2f taken with stack trace [, , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.811641] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "port-0fd0e9d9-5a64-4532-a1ea-27b2489bdf2f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.811758] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "port-0fd0e9d9-5a64-4532-a1ea-27b2489bdf2f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.812094] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "port-0fd0e9d9-5a64-4532-a1ea-27b2489bdf2f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.812239] env[65306]: DEBUG networking_nsxv3.api.rpc [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0fd0e9d9-5a64-4532-a1ea-27b2489bdf2f',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 639.820691] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.820827] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.820900] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.821165] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.821304] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.821518] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.821627] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.821694] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.821858] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.821938] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.822036] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 55a6ae08-0730-4d04-bc2c-3f0c36758315 already deleted. [ 639.822121] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-55a6ae08-0730-4d04-bc2c-3f0c36758315" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.033024] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-6951f012-9730-40bd-a7af-9b70cd598b05 taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.033024] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6951f012-9730-40bd-a7af-9b70cd598b05" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.319445] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.319680] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.319804] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.320170] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.320360] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.320524] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Segment Port 0fd0e9d9-5a64-4532-a1ea-27b2489bdf2f not found, creating... [ 640.320793] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.320938] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.321070] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.321301] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.321456] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.321766] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.324627] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.324917] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.325351] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.325528] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.325688] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Resource: SegmentPort with ID: 0fd0e9d9-5a64-4532-a1ea-27b2489bdf2f is going to be created. [ 640.355652] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.355652] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.355827] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.356338] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.356824] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.357093] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "port-0fd0e9d9-5a64-4532-a1ea-27b2489bdf2f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.486042] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6951f012-9730-40bd-a7af-9b70cd598b05 in Status: SUCCESS [ 640.486389] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6951f012-9730-40bd-a7af-9b70cd598b05" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.486639] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6951f012-9730-40bd-a7af-9b70cd598b05" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.486964] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6951f012-9730-40bd-a7af-9b70cd598b05" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.487198] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.487337] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.487425] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.487595] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.487692] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.487785] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6951f012-9730-40bd-a7af-9b70cd598b05" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.487881] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6951f012-9730-40bd-a7af-9b70cd598b05',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 640.929049] env[65306]: INFO networking_nsxv3.common.synchronization [None req-ed66bb4f-b030-497b-b907-905d5fd9a8a8 tempest-ServerActionsTestJSON-437813836 tempest-ServerActionsTestJSON-437813836-project-member] Enqueued Resource ID: 6e403189-fcac-40e3-aa50-4c17f4d29895 with Priority: HIGHEST for action security_group_rules [ 640.929654] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6e403189-fcac-40e3-aa50-4c17f4d29895 with Priority: HIGHEST for action security_group_rules [ 640.929880] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6e403189-fcac-40e3-aa50-4c17f4d29895 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.930016] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6e403189-fcac-40e3-aa50-4c17f4d29895" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.930100] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6e403189-fcac-40e3-aa50-4c17f4d29895" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.930382] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6e403189-fcac-40e3-aa50-4c17f4d29895" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.930497] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6e403189-fcac-40e3-aa50-4c17f4d29895',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 640.990129] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-6951f012-9730-40bd-a7af-9b70cd598b05 taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.990523] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6951f012-9730-40bd-a7af-9b70cd598b05" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.990615] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6951f012-9730-40bd-a7af-9b70cd598b05" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.991267] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6951f012-9730-40bd-a7af-9b70cd598b05" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.991521] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.991694] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.991772] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.991980] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.992190] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.992190] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6951f012-9730-40bd-a7af-9b70cd598b05" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.992354] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-6951f012-9730-40bd-a7af-9b70cd598b05 taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.992450] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6951f012-9730-40bd-a7af-9b70cd598b05" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.992509] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6951f012-9730-40bd-a7af-9b70cd598b05" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.992659] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6951f012-9730-40bd-a7af-9b70cd598b05" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.992796] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.992886] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.992944] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.993092] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.993165] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.993280] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6951f012-9730-40bd-a7af-9b70cd598b05" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.993386] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6951f012-9730-40bd-a7af-9b70cd598b05',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 641.103978] env[65306]: INFO networking_nsxv3.common.synchronization [req-ea6f03de-6aaf-410b-9593-5584fcb48240 req-665f93cc-cb43-4cf9-a990-d6bdbcbd411d service nova] Enqueued Resource ID: 55a6ae08-0730-4d04-bc2c-3f0c36758315 with Priority: HIGHEST for action security_group_rules [ 641.104172] env[65306]: INFO networking_nsxv3.common.synchronization [req-ea6f03de-6aaf-410b-9593-5584fcb48240 req-665f93cc-cb43-4cf9-a990-d6bdbcbd411d service nova] Enqueued Resource ID: 55a6ae08-0730-4d04-bc2c-3f0c36758315 with Priority: HIGHEST for action security_group_members [ 641.104306] env[65306]: INFO networking_nsxv3.common.synchronization [req-ea6f03de-6aaf-410b-9593-5584fcb48240 req-665f93cc-cb43-4cf9-a990-d6bdbcbd411d service nova] Enqueued Resource ID: 0fd0e9d9-5a64-4532-a1ea-27b2489bdf2f with Priority: HIGHEST for action port [ 641.104534] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 55a6ae08-0730-4d04-bc2c-3f0c36758315 with Priority: HIGHEST for action security_group_rules [ 641.104663] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 55a6ae08-0730-4d04-bc2c-3f0c36758315 with Priority: HIGHEST for action security_group_members [ 641.104789] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0fd0e9d9-5a64-4532-a1ea-27b2489bdf2f with Priority: HIGHEST for action port [ 641.105328] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock rules-55a6ae08-0730-4d04-bc2c-3f0c36758315 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.105683] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-55a6ae08-0730-4d04-bc2c-3f0c36758315" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.105683] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-55a6ae08-0730-4d04-bc2c-3f0c36758315" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.105880] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-55a6ae08-0730-4d04-bc2c-3f0c36758315" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.105880] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('55a6ae08-0730-4d04-bc2c-3f0c36758315',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 641.106694] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-55a6ae08-0730-4d04-bc2c-3f0c36758315 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.106808] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-55a6ae08-0730-4d04-bc2c-3f0c36758315" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.106884] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-55a6ae08-0730-4d04-bc2c-3f0c36758315" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.107068] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-55a6ae08-0730-4d04-bc2c-3f0c36758315" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.107219] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.108581] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.108581] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.108581] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.108581] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.108581] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('55a6ae08-0730-4d04-bc2c-3f0c36758315',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 641.109017] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock port-0fd0e9d9-5a64-4532-a1ea-27b2489bdf2f taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.109017] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0fd0e9d9-5a64-4532-a1ea-27b2489bdf2f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.109120] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0fd0e9d9-5a64-4532-a1ea-27b2489bdf2f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.109204] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0fd0e9d9-5a64-4532-a1ea-27b2489bdf2f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.109578] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0fd0e9d9-5a64-4532-a1ea-27b2489bdf2f',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 641.196985] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e3e0f6b2-2984-4938-adcc-0374a714ff76 in Status: SUCCESS [ 641.197327] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e3e0f6b2-2984-4938-adcc-0374a714ff76" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.197480] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e3e0f6b2-2984-4938-adcc-0374a714ff76" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.197560] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e3e0f6b2-2984-4938-adcc-0374a714ff76" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.197914] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.198041] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.198041] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.200547] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.200547] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.200547] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e3e0f6b2-2984-4938-adcc-0374a714ff76" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.200547] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e3e0f6b2-2984-4938-adcc-0374a714ff76',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 641.293479] env[65306]: INFO networking_nsxv3.common.synchronization [None req-c8a65d46-340b-4bc8-854c-7d70efc4baee tempest-ServerActionsTestJSON-437813836 tempest-ServerActionsTestJSON-437813836-project-member] Enqueued Resource ID: 6e403189-fcac-40e3-aa50-4c17f4d29895 with Priority: HIGHEST for action security_group_rules [ 641.294225] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6e403189-fcac-40e3-aa50-4c17f4d29895 with Priority: HIGHEST for action security_group_rules [ 641.294437] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6e403189-fcac-40e3-aa50-4c17f4d29895 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.294542] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6e403189-fcac-40e3-aa50-4c17f4d29895" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.356328] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ef5de9e7-0c3b-4386-af3c-de134eff75f3 in Status: SUCCESS [ 641.357502] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ef5de9e7-0c3b-4386-af3c-de134eff75f3" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.357810] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ef5de9e7-0c3b-4386-af3c-de134eff75f3" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.358113] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ef5de9e7-0c3b-4386-af3c-de134eff75f3" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.358342] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.358449] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.358505] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.358672] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.358832] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.358934] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ef5de9e7-0c3b-4386-af3c-de134eff75f3" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.360275] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ef5de9e7-0c3b-4386-af3c-de134eff75f3',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 641.454335] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.454459] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.454505] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.454876] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.454876] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.454876] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6e403189-fcac-40e3-aa50-4c17f4d29895 already deleted. [ 641.455034] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6e403189-fcac-40e3-aa50-4c17f4d29895" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.455517] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6e403189-fcac-40e3-aa50-4c17f4d29895" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.455517] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6e403189-fcac-40e3-aa50-4c17f4d29895" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.455517] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6e403189-fcac-40e3-aa50-4c17f4d29895',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 641.496229] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6951f012-9730-40bd-a7af-9b70cd598b05: rpc.has_security_group_logging(os_id): False [ 641.514339] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.514542] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.514615] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.514838] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.515045] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.515139] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.515235] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.515298] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.515446] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.515521] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.515702] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.515792] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.515853] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.515993] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.516424] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.517434] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.517434] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.517632] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.517883] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.518051] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.518215] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6951f012-9730-40bd-a7af-9b70cd598b05 is going to be updated. [ 641.586845] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.586971] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.587741] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.587741] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.587741] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.601801] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6951f012-9730-40bd-a7af-9b70cd598b05 in Status: IN_PROGRESS for 2s [ 641.612723] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-55a6ae08-0730-4d04-bc2c-3f0c36758315 taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.612863] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-55a6ae08-0730-4d04-bc2c-3f0c36758315" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.613016] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('55a6ae08-0730-4d04-bc2c-3f0c36758315',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 641.614414] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0fd0e9d9-5a64-4532-a1ea-27b2489bdf2f with status ACTIVE [ 641.614606] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.614728] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.614797] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.614999] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.615100] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.615650] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.615650] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.615650] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.615650] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.615650] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.615929] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.615929] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.616014] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.616096] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.616571] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.616571] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0fd0e9d9-5a64-4532-a1ea-27b2489bdf2f is going to be updated. [ 641.655031] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.655031] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.655031] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.655031] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.655031] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.655031] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0fd0e9d9-5a64-4532-a1ea-27b2489bdf2f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.701018] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-e3e0f6b2-2984-4938-adcc-0374a714ff76 taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.701246] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e3e0f6b2-2984-4938-adcc-0374a714ff76" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.701309] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e3e0f6b2-2984-4938-adcc-0374a714ff76" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.701521] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e3e0f6b2-2984-4938-adcc-0374a714ff76" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.701946] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.701946] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.701946] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.702166] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.702166] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.702166] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e3e0f6b2-2984-4938-adcc-0374a714ff76" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.702370] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-e3e0f6b2-2984-4938-adcc-0374a714ff76 taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.702431] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e3e0f6b2-2984-4938-adcc-0374a714ff76" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.702478] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e3e0f6b2-2984-4938-adcc-0374a714ff76" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.702606] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e3e0f6b2-2984-4938-adcc-0374a714ff76" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.702743] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.704010] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.704010] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.704010] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.704010] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.704010] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e3e0f6b2-2984-4938-adcc-0374a714ff76" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.704010] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e3e0f6b2-2984-4938-adcc-0374a714ff76',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 641.864456] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ef5de9e7-0c3b-4386-af3c-de134eff75f3',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 641.979914] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.980258] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.980258] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.980500] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.980572] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.980679] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6e403189-fcac-40e3-aa50-4c17f4d29895 already deleted. [ 641.980795] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6e403189-fcac-40e3-aa50-4c17f4d29895" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.118281] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('55a6ae08-0730-4d04-bc2c-3f0c36758315',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 642.206194] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e3e0f6b2-2984-4938-adcc-0374a714ff76: rpc.has_security_group_logging(os_id): False [ 642.227224] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.227440] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.227440] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.227652] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.227745] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.227951] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.228222] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.228222] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.228332] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.228365] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.228546] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.228638] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.228694] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.228921] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.228991] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.229222] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.229320] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.229382] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.229554] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.229596] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.229672] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e3e0f6b2-2984-4938-adcc-0374a714ff76 is going to be updated. [ 642.299255] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.299255] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.299255] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.299255] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.299255] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.315131] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e3e0f6b2-2984-4938-adcc-0374a714ff76 in Status: IN_PROGRESS for 2s [ 642.368073] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ef5de9e7-0c3b-4386-af3c-de134eff75f3: rpc.has_security_group_logging(os_id): False [ 642.390760] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.394020] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.394020] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.394020] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.394020] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.394020] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.394020] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.394020] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.394020] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.394020] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.394020] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ef5de9e7-0c3b-4386-af3c-de134eff75f3 is going to be created. [ 642.471784] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.471784] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.471784] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.472285] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.473067] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.487126] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ef5de9e7-0c3b-4386-af3c-de134eff75f3 in Status: IN_PROGRESS for 2s [ 642.621069] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.621425] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.621425] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.621810] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.621810] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.621968] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 55a6ae08-0730-4d04-bc2c-3f0c36758315 is going to be created. [ 642.657688] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.657881] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.657957] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.658214] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.658396] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.671788] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 55a6ae08-0730-4d04-bc2c-3f0c36758315 in Status: UNINITIALIZED for 2s [ 642.795611] env[65306]: INFO networking_nsxv3.common.synchronization [None req-fa08c8f6-e14b-4a8b-91af-a81c115e1cd0 None None] Enqueued Resource ID: c08c169e-36e7-4c7a-91d3-977f815d207e with Priority: HIGHEST for action port [ 642.796325] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c08c169e-36e7-4c7a-91d3-977f815d207e with Priority: HIGHEST for action port [ 642.796647] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock port-c08c169e-36e7-4c7a-91d3-977f815d207e taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.796799] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c08c169e-36e7-4c7a-91d3-977f815d207e" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.796888] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c08c169e-36e7-4c7a-91d3-977f815d207e" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.797773] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c08c169e-36e7-4c7a-91d3-977f815d207e" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.797980] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c08c169e-36e7-4c7a-91d3-977f815d207e',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 643.224256] env[65306]: INFO networking_nsxv3.common.synchronization [req-fc56c793-8bab-4f21-8e38-4e91cd4f25c5 req-b99aef04-2c96-4d89-901b-7e383b0be98d tempest-AttachInterfacesV270Test-932887390 tempest-AttachInterfacesV270Test-932887390-project-member] Enqueued Resource ID: a7dafaf4-f702-4dc9-bc77-265f5268966a with Priority: HIGHEST for action security_group_members [ 643.224256] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a7dafaf4-f702-4dc9-bc77-265f5268966a with Priority: HIGHEST for action security_group_members [ 643.224256] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-a7dafaf4-f702-4dc9-bc77-265f5268966a taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.224256] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a7dafaf4-f702-4dc9-bc77-265f5268966a" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.224256] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a7dafaf4-f702-4dc9-bc77-265f5268966a" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.224256] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a7dafaf4-f702-4dc9-bc77-265f5268966a" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.224839] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.225700] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.225700] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.225700] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.225700] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.225700] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a7dafaf4-f702-4dc9-bc77-265f5268966a',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 643.301845] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c08c169e-36e7-4c7a-91d3-977f815d207e [ 643.302188] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.302369] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.302465] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.302899] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.302899] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.303239] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c08c169e-36e7-4c7a-91d3-977f815d207e already deleted. [ 643.303239] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c08c169e-36e7-4c7a-91d3-977f815d207e" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.619787] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6951f012-9730-40bd-a7af-9b70cd598b05 in Status: SUCCESS [ 643.623353] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6951f012-9730-40bd-a7af-9b70cd598b05" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.623578] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6951f012-9730-40bd-a7af-9b70cd598b05" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.623831] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6951f012-9730-40bd-a7af-9b70cd598b05" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.623925] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6951f012-9730-40bd-a7af-9b70cd598b05',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 643.727935] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.727935] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.727935] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.728665] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.728872] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.729475] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.729714] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.729767] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.730000] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.730136] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.730260] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a7dafaf4-f702-4dc9-bc77-265f5268966a is going to be updated. [ 643.743226] env[65306]: INFO networking_nsxv3.common.synchronization [None req-ebb19e4a-217d-46b3-96ed-00dcbe08fc51 tempest-AttachInterfacesUnderV243Test-82564794 tempest-AttachInterfacesUnderV243Test-82564794-project-member] Enqueued Resource ID: 30524546-2ed3-474c-bf2b-fc6aff50dfec with Priority: HIGHEST for action security_group_rules [ 643.744634] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 30524546-2ed3-474c-bf2b-fc6aff50dfec with Priority: HIGHEST for action security_group_rules [ 643.744999] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock rules-30524546-2ed3-474c-bf2b-fc6aff50dfec taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.745167] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-30524546-2ed3-474c-bf2b-fc6aff50dfec" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.745259] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-30524546-2ed3-474c-bf2b-fc6aff50dfec" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.745542] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-30524546-2ed3-474c-bf2b-fc6aff50dfec" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.745656] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('30524546-2ed3-474c-bf2b-fc6aff50dfec',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 643.767369] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.767531] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.767531] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.767732] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.767907] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.782023] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a7dafaf4-f702-4dc9-bc77-265f5268966a in Status: IN_PROGRESS for 2s [ 644.127128] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-6951f012-9730-40bd-a7af-9b70cd598b05 taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.127128] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6951f012-9730-40bd-a7af-9b70cd598b05" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.127128] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6951f012-9730-40bd-a7af-9b70cd598b05" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.128689] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6951f012-9730-40bd-a7af-9b70cd598b05" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.128689] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.128689] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.128689] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.128689] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.128689] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.128689] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6951f012-9730-40bd-a7af-9b70cd598b05" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.128689] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6951f012-9730-40bd-a7af-9b70cd598b05',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 644.145985] env[65306]: INFO networking_nsxv3.common.synchronization [None req-d62821ba-e01a-4cf2-87d2-90ec6f6e55ab tempest-AttachInterfacesUnderV243Test-82564794 tempest-AttachInterfacesUnderV243Test-82564794-project-member] Enqueued Resource ID: 30524546-2ed3-474c-bf2b-fc6aff50dfec with Priority: HIGHEST for action security_group_rules [ 644.146423] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 30524546-2ed3-474c-bf2b-fc6aff50dfec with Priority: HIGHEST for action security_group_rules [ 644.146770] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock rules-30524546-2ed3-474c-bf2b-fc6aff50dfec taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.146882] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-30524546-2ed3-474c-bf2b-fc6aff50dfec" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.271158] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.271470] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.271470] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.271616] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.271725] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.271831] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 30524546-2ed3-474c-bf2b-fc6aff50dfec already deleted. [ 644.271917] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-30524546-2ed3-474c-bf2b-fc6aff50dfec" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.272091] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-30524546-2ed3-474c-bf2b-fc6aff50dfec" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.272250] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-30524546-2ed3-474c-bf2b-fc6aff50dfec" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.272352] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('30524546-2ed3-474c-bf2b-fc6aff50dfec',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 644.334968] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e3e0f6b2-2984-4938-adcc-0374a714ff76 in Status: SUCCESS [ 644.335455] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e3e0f6b2-2984-4938-adcc-0374a714ff76" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.503933] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ef5de9e7-0c3b-4386-af3c-de134eff75f3 in Status: SUCCESS [ 644.503933] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ef5de9e7-0c3b-4386-af3c-de134eff75f3" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.632719] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-6951f012-9730-40bd-a7af-9b70cd598b05 taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.635545] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6951f012-9730-40bd-a7af-9b70cd598b05" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.635545] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6951f012-9730-40bd-a7af-9b70cd598b05" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.635545] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6951f012-9730-40bd-a7af-9b70cd598b05" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.635545] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.635545] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.635545] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.635545] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.635545] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.635545] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6951f012-9730-40bd-a7af-9b70cd598b05" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.635545] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-6951f012-9730-40bd-a7af-9b70cd598b05 taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.635545] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6951f012-9730-40bd-a7af-9b70cd598b05" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.635545] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6951f012-9730-40bd-a7af-9b70cd598b05" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.635545] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6951f012-9730-40bd-a7af-9b70cd598b05" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.636790] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.637163] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.637354] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.638308] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.638602] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.639479] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6951f012-9730-40bd-a7af-9b70cd598b05" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.639479] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6951f012-9730-40bd-a7af-9b70cd598b05',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 644.686344] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 55a6ae08-0730-4d04-bc2c-3f0c36758315 in Status: SUCCESS [ 644.686344] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-55a6ae08-0730-4d04-bc2c-3f0c36758315" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.686344] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-55a6ae08-0730-4d04-bc2c-3f0c36758315" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.686344] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-55a6ae08-0730-4d04-bc2c-3f0c36758315" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.686344] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.686344] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.686344] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.686344] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.686344] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.686344] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-55a6ae08-0730-4d04-bc2c-3f0c36758315" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.686344] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('55a6ae08-0730-4d04-bc2c-3f0c36758315',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 644.799251] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.801057] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.801057] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.801057] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.801057] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.801057] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 30524546-2ed3-474c-bf2b-fc6aff50dfec already deleted. [ 644.801057] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-30524546-2ed3-474c-bf2b-fc6aff50dfec" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.856296] env[65306]: INFO networking_nsxv3.common.synchronization [None req-b4b83a28-aca5-4aa2-b700-29cc09e647c8 None None] Enqueued Resource ID: b891905d-dd7d-4399-b5c2-624e3fb186b0 with Priority: HIGHEST for action port [ 644.856296] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b891905d-dd7d-4399-b5c2-624e3fb186b0 with Priority: HIGHEST for action port [ 644.856296] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock port-b891905d-dd7d-4399-b5c2-624e3fb186b0 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.857070] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b891905d-dd7d-4399-b5c2-624e3fb186b0" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.857070] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b891905d-dd7d-4399-b5c2-624e3fb186b0" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.857338] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b891905d-dd7d-4399-b5c2-624e3fb186b0" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.858055] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b891905d-dd7d-4399-b5c2-624e3fb186b0',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 645.142664] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6951f012-9730-40bd-a7af-9b70cd598b05: rpc.has_security_group_logging(os_id): False [ 645.165312] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.165468] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.165543] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.165761] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.165854] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.167376] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.167574] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.167648] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.167857] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.167945] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.168952] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.168952] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.168952] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.168952] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.168952] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.168952] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.168952] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.169755] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.169755] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.169755] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.169755] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6951f012-9730-40bd-a7af-9b70cd598b05 is going to be updated. [ 645.190751] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-55a6ae08-0730-4d04-bc2c-3f0c36758315 taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.190751] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-55a6ae08-0730-4d04-bc2c-3f0c36758315" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.190751] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-55a6ae08-0730-4d04-bc2c-3f0c36758315" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.190980] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-55a6ae08-0730-4d04-bc2c-3f0c36758315" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.191087] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.191505] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.191505] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.191505] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.191708] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.191708] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-55a6ae08-0730-4d04-bc2c-3f0c36758315" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.191807] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-55a6ae08-0730-4d04-bc2c-3f0c36758315 taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.191896] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-55a6ae08-0730-4d04-bc2c-3f0c36758315" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.191993] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-55a6ae08-0730-4d04-bc2c-3f0c36758315" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.192211] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-55a6ae08-0730-4d04-bc2c-3f0c36758315" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.192441] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.192590] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.192680] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.192860] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.195411] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.195411] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-55a6ae08-0730-4d04-bc2c-3f0c36758315" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.195411] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('55a6ae08-0730-4d04-bc2c-3f0c36758315',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 645.262215] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.263292] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.263596] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.263875] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.264047] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.290907] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6951f012-9730-40bd-a7af-9b70cd598b05 in Status: IN_PROGRESS for 2s [ 645.361335] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b891905d-dd7d-4399-b5c2-624e3fb186b0 [ 645.361871] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.362056] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.362056] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.362201] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.363238] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.363238] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b891905d-dd7d-4399-b5c2-624e3fb186b0 already deleted. [ 645.363238] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b891905d-dd7d-4399-b5c2-624e3fb186b0" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.482680] env[65306]: INFO networking_nsxv3.common.synchronization [None req-8d937644-a98f-4caa-989e-2dcc4b6019cb None None] Enqueued Resource ID: d034e68e-e550-4da8-ae39-e7ec69df7bf7 with Priority: HIGHEST for action port [ 645.484218] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d034e68e-e550-4da8-ae39-e7ec69df7bf7 with Priority: HIGHEST for action port [ 645.484564] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock port-d034e68e-e550-4da8-ae39-e7ec69df7bf7 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.484885] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d034e68e-e550-4da8-ae39-e7ec69df7bf7" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.485751] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d034e68e-e550-4da8-ae39-e7ec69df7bf7" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.485751] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d034e68e-e550-4da8-ae39-e7ec69df7bf7" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.486030] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d034e68e-e550-4da8-ae39-e7ec69df7bf7',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 645.696978] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 55a6ae08-0730-4d04-bc2c-3f0c36758315: rpc.has_security_group_logging(os_id): False [ 645.721517] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.721517] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.721517] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.723281] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.723281] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.723281] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.723281] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.723281] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.723281] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.723281] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.723281] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.723281] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.723281] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.723952] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.723952] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.725172] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.725172] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.725172] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.725172] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.725172] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.725172] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 55a6ae08-0730-4d04-bc2c-3f0c36758315 is going to be created. [ 645.796343] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a7dafaf4-f702-4dc9-bc77-265f5268966a in Status: SUCCESS [ 645.796545] env[65306]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a7dafaf4-f702-4dc9-bc77-265f5268966a deletion is rescheduled due to dependency. [ 645.796704] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a7dafaf4-f702-4dc9-bc77-265f5268966a" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.798963] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.799156] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.799229] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.799448] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.799629] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.815571] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 55a6ae08-0730-4d04-bc2c-3f0c36758315 in Status: IN_PROGRESS for 2s [ 645.989605] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d034e68e-e550-4da8-ae39-e7ec69df7bf7 [ 645.990548] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.990715] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.990835] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.991082] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.991187] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.991285] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d034e68e-e550-4da8-ae39-e7ec69df7bf7 already deleted. [ 645.991375] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d034e68e-e550-4da8-ae39-e7ec69df7bf7" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.309355] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6951f012-9730-40bd-a7af-9b70cd598b05 in Status: SUCCESS [ 647.309355] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6951f012-9730-40bd-a7af-9b70cd598b05" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.832752] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 55a6ae08-0730-4d04-bc2c-3f0c36758315 in Status: SUCCESS [ 647.832752] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-55a6ae08-0730-4d04-bc2c-3f0c36758315" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.469088] env[65306]: INFO networking_nsxv3.common.synchronization [None req-4664d8ff-a3b5-46a8-855a-80fbdb686aa1 None None] Enqueued Resource ID: 5f46239e-4539-4b32-b56d-65ea64e2ef30 with Priority: HIGHEST for action port [ 649.469827] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5f46239e-4539-4b32-b56d-65ea64e2ef30 with Priority: HIGHEST for action port [ 649.470340] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock port-5f46239e-4539-4b32-b56d-65ea64e2ef30 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.470481] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5f46239e-4539-4b32-b56d-65ea64e2ef30" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.470550] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5f46239e-4539-4b32-b56d-65ea64e2ef30" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.470816] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5f46239e-4539-4b32-b56d-65ea64e2ef30" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.470937] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5f46239e-4539-4b32-b56d-65ea64e2ef30',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 649.973408] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5f46239e-4539-4b32-b56d-65ea64e2ef30 [ 649.973795] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.974011] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.974104] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.974361] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.974477] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.974599] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5f46239e-4539-4b32-b56d-65ea64e2ef30 already deleted. [ 649.974698] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5f46239e-4539-4b32-b56d-65ea64e2ef30" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.726196] env[65306]: INFO networking_nsxv3.common.synchronization [req-57359262-ff89-454f-88bf-753e6a1a9b1c req-2c398819-cc43-47a8-a9cf-8ef23ccabf4c tempest-VolumesAdminNegativeTest-357972443 tempest-VolumesAdminNegativeTest-357972443-project-member] Enqueued Resource ID: ed6cda65-baf0-42a6-bcdd-7a946b27c841 with Priority: HIGHEST for action security_group_members [ 650.726747] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ed6cda65-baf0-42a6-bcdd-7a946b27c841 with Priority: HIGHEST for action security_group_members [ 650.727097] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-ed6cda65-baf0-42a6-bcdd-7a946b27c841 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.727210] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ed6cda65-baf0-42a6-bcdd-7a946b27c841" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.727280] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ed6cda65-baf0-42a6-bcdd-7a946b27c841" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.727591] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ed6cda65-baf0-42a6-bcdd-7a946b27c841" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.727684] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.727795] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.727795] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.727904] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.727989] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.728094] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ed6cda65-baf0-42a6-bcdd-7a946b27c841',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 651.231477] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.231558] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.231714] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.231851] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.231944] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.232189] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.232294] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.232360] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.232550] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.232609] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.232702] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ed6cda65-baf0-42a6-bcdd-7a946b27c841 is going to be updated. [ 651.263157] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.264408] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.264493] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.264744] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.264883] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.278077] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ed6cda65-baf0-42a6-bcdd-7a946b27c841 in Status: IN_PROGRESS for 2s [ 651.791549] env[65306]: INFO networking_nsxv3.common.synchronization [req-65ee1634-9da0-4fe5-8157-d3a3eec4bcda req-0ef321bd-dfbd-4f1c-a07e-d21f3a9820ea tempest-DeleteServersAdminTestJSON-721532732 tempest-DeleteServersAdminTestJSON-721532732-project-member] Enqueued Resource ID: 70b8bb37-9445-4339-82b5-ebb24bd0be78 with Priority: HIGHEST for action security_group_members [ 651.792137] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 70b8bb37-9445-4339-82b5-ebb24bd0be78 with Priority: HIGHEST for action security_group_members [ 651.793018] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-70b8bb37-9445-4339-82b5-ebb24bd0be78 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.793872] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-70b8bb37-9445-4339-82b5-ebb24bd0be78" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.794016] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-70b8bb37-9445-4339-82b5-ebb24bd0be78" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.794291] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-70b8bb37-9445-4339-82b5-ebb24bd0be78" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.794687] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.795035] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.796553] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.796815] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.796940] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.797103] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('70b8bb37-9445-4339-82b5-ebb24bd0be78',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 652.239949] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock network-707 taken with stack trace [, , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.239949] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "network-707" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.239949] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "network-707" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.239949] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "network-707" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.239949] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.239949] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.239949] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.240341] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.240664] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.240664] env[65306]: DEBUG dogpile.cache.region [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] No value present for key: 'zone-id' {{(pid=65306) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 652.241059] env[65306]: DEBUG dogpile.lock [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] NeedRegenerationException {{(pid=65306) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 652.241059] env[65306]: DEBUG dogpile.lock [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] no value, waiting for create lock {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 652.241059] env[65306]: DEBUG dogpile.lock [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] value creation lock acquired {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 652.241059] env[65306]: DEBUG dogpile.cache.region [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] No value present for key: 'zone-id' {{(pid=65306) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 652.241374] env[65306]: DEBUG dogpile.lock [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Calling creation function for not-yet-present value {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 652.241374] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 652.270268] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 652.270854] env[65306]: DEBUG dogpile.cache.region [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Cache value generated in 0.029 seconds for key(s): 'zone-id' {{(pid=65306) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 652.271533] env[65306]: DEBUG dogpile.lock [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Released creation lock {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 652.271533] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "network-707" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.271815] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock port-e0f872f0-785c-49ec-baff-86346277b0c3 taken with stack trace [, , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.272102] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "port-e0f872f0-785c-49ec-baff-86346277b0c3" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.272175] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "port-e0f872f0-785c-49ec-baff-86346277b0c3" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.273286] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "port-e0f872f0-785c-49ec-baff-86346277b0c3" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.273286] env[65306]: DEBUG networking_nsxv3.api.rpc [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e0f872f0-785c-49ec-baff-86346277b0c3',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 652.300332] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.300332] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.300332] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.300332] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.300632] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.300632] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.300792] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.300792] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.303372] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.303492] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.303596] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 70b8bb37-9445-4339-82b5-ebb24bd0be78 is going to be updated. [ 652.346229] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.347313] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.347395] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.347628] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.347783] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.359324] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 70b8bb37-9445-4339-82b5-ebb24bd0be78 in Status: IN_PROGRESS for 2s [ 652.775332] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.776423] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.776423] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.776423] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.776423] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.776636] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Segment Port e0f872f0-785c-49ec-baff-86346277b0c3 not found, creating... [ 652.776805] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.779817] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.779817] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.779817] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.779817] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.779817] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.779817] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.779817] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.779817] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.779817] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.779817] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Resource: SegmentPort with ID: e0f872f0-785c-49ec-baff-86346277b0c3 is going to be created. [ 652.806130] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.806471] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.806608] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.806845] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.807129] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.807616] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "port-e0f872f0-785c-49ec-baff-86346277b0c3" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.288836] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ed6cda65-baf0-42a6-bcdd-7a946b27c841 in Status: SUCCESS [ 653.289025] env[65306]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ed6cda65-baf0-42a6-bcdd-7a946b27c841 deletion is rescheduled due to dependency. [ 653.289199] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ed6cda65-baf0-42a6-bcdd-7a946b27c841" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.588482] env[65306]: INFO networking_nsxv3.common.synchronization [req-65ee1634-9da0-4fe5-8157-d3a3eec4bcda req-552e1e01-7407-4c42-9030-826bd870949e service nova] Enqueued Resource ID: 70b8bb37-9445-4339-82b5-ebb24bd0be78 with Priority: HIGHEST for action security_group_rules [ 653.588673] env[65306]: INFO networking_nsxv3.common.synchronization [req-65ee1634-9da0-4fe5-8157-d3a3eec4bcda req-552e1e01-7407-4c42-9030-826bd870949e service nova] Enqueued Resource ID: 70b8bb37-9445-4339-82b5-ebb24bd0be78 with Priority: HIGHEST for action security_group_members [ 653.588795] env[65306]: INFO networking_nsxv3.common.synchronization [req-65ee1634-9da0-4fe5-8157-d3a3eec4bcda req-552e1e01-7407-4c42-9030-826bd870949e service nova] Enqueued Resource ID: e0f872f0-785c-49ec-baff-86346277b0c3 with Priority: HIGHEST for action port [ 653.589518] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 70b8bb37-9445-4339-82b5-ebb24bd0be78 with Priority: HIGHEST for action security_group_rules [ 653.589729] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 70b8bb37-9445-4339-82b5-ebb24bd0be78 with Priority: HIGHEST for action security_group_members [ 653.589789] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e0f872f0-785c-49ec-baff-86346277b0c3 with Priority: HIGHEST for action port [ 653.590219] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock rules-70b8bb37-9445-4339-82b5-ebb24bd0be78 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.590360] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-70b8bb37-9445-4339-82b5-ebb24bd0be78" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.590427] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-70b8bb37-9445-4339-82b5-ebb24bd0be78" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.590726] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-70b8bb37-9445-4339-82b5-ebb24bd0be78" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.590726] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('70b8bb37-9445-4339-82b5-ebb24bd0be78',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 653.591754] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-70b8bb37-9445-4339-82b5-ebb24bd0be78 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.591876] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-70b8bb37-9445-4339-82b5-ebb24bd0be78" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.593159] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock port-e0f872f0-785c-49ec-baff-86346277b0c3 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.593159] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e0f872f0-785c-49ec-baff-86346277b0c3" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.593159] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e0f872f0-785c-49ec-baff-86346277b0c3" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.593159] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e0f872f0-785c-49ec-baff-86346277b0c3" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.593159] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e0f872f0-785c-49ec-baff-86346277b0c3',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 654.094856] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-70b8bb37-9445-4339-82b5-ebb24bd0be78 taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.095972] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-70b8bb37-9445-4339-82b5-ebb24bd0be78" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.095972] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e0f872f0-785c-49ec-baff-86346277b0c3 with status ACTIVE [ 654.095972] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.095972] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.095972] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.095972] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.095972] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.096483] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.096483] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.096483] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.096483] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.096483] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.096656] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.096702] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.096742] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.097078] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.097078] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.097078] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e0f872f0-785c-49ec-baff-86346277b0c3 is going to be updated. [ 654.123566] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.124536] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.124828] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.125404] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.125404] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.125720] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e0f872f0-785c-49ec-baff-86346277b0c3" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.298150] env[65306]: INFO networking_nsxv3.common.synchronization [req-8173fee6-3dd1-41d8-8407-b4d3e067fb34 req-1a775d7e-490b-4a7f-b95b-7f89288bf070 tempest-ServerActionsTestJSON-437813836 tempest-ServerActionsTestJSON-437813836-project-member] Enqueued Resource ID: 6e403189-fcac-40e3-aa50-4c17f4d29895 with Priority: HIGHEST for action security_group_members [ 654.298307] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6e403189-fcac-40e3-aa50-4c17f4d29895 with Priority: HIGHEST for action security_group_members [ 654.298676] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-6e403189-fcac-40e3-aa50-4c17f4d29895 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.298811] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6e403189-fcac-40e3-aa50-4c17f4d29895" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.298870] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6e403189-fcac-40e3-aa50-4c17f4d29895" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.299203] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6e403189-fcac-40e3-aa50-4c17f4d29895" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.299361] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.299492] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.299562] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.299766] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.299848] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.300019] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6e403189-fcac-40e3-aa50-4c17f4d29895',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 654.370119] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 70b8bb37-9445-4339-82b5-ebb24bd0be78 in Status: SUCCESS [ 654.370377] env[65306]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 70b8bb37-9445-4339-82b5-ebb24bd0be78 deletion is rescheduled due to dependency. [ 654.370495] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-70b8bb37-9445-4339-82b5-ebb24bd0be78" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.370778] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-70b8bb37-9445-4339-82b5-ebb24bd0be78" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.370778] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-70b8bb37-9445-4339-82b5-ebb24bd0be78" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.370979] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.371121] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.371215] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.371320] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.371405] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.371492] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('70b8bb37-9445-4339-82b5-ebb24bd0be78',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 654.803355] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.803626] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.803715] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.804057] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.804210] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.804523] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.804687] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.804906] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.805366] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.806171] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.806171] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6e403189-fcac-40e3-aa50-4c17f4d29895 already deleted. [ 654.806171] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6e403189-fcac-40e3-aa50-4c17f4d29895" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.873979] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('70b8bb37-9445-4339-82b5-ebb24bd0be78',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 655.012564] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock network-910 taken with stack trace [, , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.013009] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "network-910" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.013245] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "network-910" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.013618] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "network-910" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.013909] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.014398] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.014398] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.014516] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.014717] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.014862] env[65306]: DEBUG dogpile.cache.region [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] No value present for key: 'zone-id' {{(pid=65306) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 655.015950] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] NeedRegenerationException {{(pid=65306) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 655.015950] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] no value, waiting for create lock {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 655.015950] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] value creation lock acquired {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 655.015950] env[65306]: DEBUG dogpile.cache.region [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] No value present for key: 'zone-id' {{(pid=65306) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 655.015950] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Calling creation function for not-yet-present value {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 655.015950] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 655.035670] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 655.035853] env[65306]: DEBUG dogpile.cache.region [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65306) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 655.035980] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Released creation lock {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 655.036171] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "network-910" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.036521] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock port-57f05d3b-3b02-4eec-864a-a0857c696d40 taken with stack trace [, , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.036748] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "port-57f05d3b-3b02-4eec-864a-a0857c696d40" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.036862] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "port-57f05d3b-3b02-4eec-864a-a0857c696d40" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.037199] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "port-57f05d3b-3b02-4eec-864a-a0857c696d40" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.037967] env[65306]: DEBUG networking_nsxv3.api.rpc [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('57f05d3b-3b02-4eec-864a-a0857c696d40',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 655.376294] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('70b8bb37-9445-4339-82b5-ebb24bd0be78',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 655.464411] env[65306]: INFO networking_nsxv3.common.synchronization [None req-271e8975-8cac-4367-8b95-a0a1afbb9661 None None] Enqueued Resource ID: 4f71afde-b756-4024-acd1-18d476543e8f with Priority: HIGHEST for action port [ 655.465601] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4f71afde-b756-4024-acd1-18d476543e8f with Priority: HIGHEST for action port [ 655.466116] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock port-4f71afde-b756-4024-acd1-18d476543e8f taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.466315] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4f71afde-b756-4024-acd1-18d476543e8f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.466447] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4f71afde-b756-4024-acd1-18d476543e8f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.466745] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4f71afde-b756-4024-acd1-18d476543e8f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.466944] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4f71afde-b756-4024-acd1-18d476543e8f',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 655.541223] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.541512] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.541767] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.541916] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.542080] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.542238] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Segment Port 57f05d3b-3b02-4eec-864a-a0857c696d40 not found, creating... [ 655.542508] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.542663] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.542787] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.543031] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.543171] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.543448] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.543598] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.543738] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.543949] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.546071] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.546429] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Resource: SegmentPort with ID: 57f05d3b-3b02-4eec-864a-a0857c696d40 is going to be created. [ 655.569577] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.570145] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.570145] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.570504] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.570856] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.571208] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "port-57f05d3b-3b02-4eec-864a-a0857c696d40" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.880260] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.880446] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.880523] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.880761] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.880857] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.880973] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 70b8bb37-9445-4339-82b5-ebb24bd0be78 is going to be updated. [ 655.924946] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.925130] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.925239] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.925405] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.925566] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.936443] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 70b8bb37-9445-4339-82b5-ebb24bd0be78 in Status: IN_PROGRESS for 2s [ 655.970313] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4f71afde-b756-4024-acd1-18d476543e8f [ 655.971497] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.971497] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.971497] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.971497] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.971497] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.971497] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4f71afde-b756-4024-acd1-18d476543e8f already deleted. [ 655.971497] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4f71afde-b756-4024-acd1-18d476543e8f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.299948] env[65306]: INFO networking_nsxv3.common.synchronization [req-8173fee6-3dd1-41d8-8407-b4d3e067fb34 req-127bada5-b885-4d5b-b6d2-1414d0e13984 service nova] Enqueued Resource ID: 6e403189-fcac-40e3-aa50-4c17f4d29895 with Priority: HIGHEST for action security_group_rules [ 656.300127] env[65306]: INFO networking_nsxv3.common.synchronization [req-8173fee6-3dd1-41d8-8407-b4d3e067fb34 req-127bada5-b885-4d5b-b6d2-1414d0e13984 service nova] Enqueued Resource ID: 6e403189-fcac-40e3-aa50-4c17f4d29895 with Priority: HIGHEST for action security_group_members [ 656.300289] env[65306]: INFO networking_nsxv3.common.synchronization [req-8173fee6-3dd1-41d8-8407-b4d3e067fb34 req-127bada5-b885-4d5b-b6d2-1414d0e13984 service nova] Enqueued Resource ID: 57f05d3b-3b02-4eec-864a-a0857c696d40 with Priority: HIGHEST for action port [ 656.300536] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6e403189-fcac-40e3-aa50-4c17f4d29895 with Priority: HIGHEST for action security_group_rules [ 656.300680] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6e403189-fcac-40e3-aa50-4c17f4d29895 with Priority: HIGHEST for action security_group_members [ 656.300777] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 57f05d3b-3b02-4eec-864a-a0857c696d40 with Priority: HIGHEST for action port [ 656.304409] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6e403189-fcac-40e3-aa50-4c17f4d29895 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.304749] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6e403189-fcac-40e3-aa50-4c17f4d29895" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.304854] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6e403189-fcac-40e3-aa50-4c17f4d29895" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.305119] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6e403189-fcac-40e3-aa50-4c17f4d29895" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.305212] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6e403189-fcac-40e3-aa50-4c17f4d29895',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 656.306125] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-6e403189-fcac-40e3-aa50-4c17f4d29895 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.306328] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6e403189-fcac-40e3-aa50-4c17f4d29895" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.306426] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6e403189-fcac-40e3-aa50-4c17f4d29895" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.306601] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6e403189-fcac-40e3-aa50-4c17f4d29895" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.306847] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.306963] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.307045] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.307202] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.307288] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.307376] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6e403189-fcac-40e3-aa50-4c17f4d29895',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 656.312812] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock port-57f05d3b-3b02-4eec-864a-a0857c696d40 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.312959] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-57f05d3b-3b02-4eec-864a-a0857c696d40" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.313030] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-57f05d3b-3b02-4eec-864a-a0857c696d40" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.313269] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-57f05d3b-3b02-4eec-864a-a0857c696d40" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.313355] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('57f05d3b-3b02-4eec-864a-a0857c696d40',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 656.511823] env[65306]: INFO networking_nsxv3.common.synchronization [req-29016e6b-f9a3-4c85-a034-1e648b817f76 req-1ba36f16-4f83-45b5-9d91-5d1fc5aeac64 tempest-ListServersNegativeTestJSON-1230971190 tempest-ListServersNegativeTestJSON-1230971190-project-member] Enqueued Resource ID: 6951f012-9730-40bd-a7af-9b70cd598b05 with Priority: HIGHEST for action security_group_members [ 656.512383] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6951f012-9730-40bd-a7af-9b70cd598b05 with Priority: HIGHEST for action security_group_members [ 656.513076] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-6951f012-9730-40bd-a7af-9b70cd598b05 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.513076] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6951f012-9730-40bd-a7af-9b70cd598b05" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.513808] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6951f012-9730-40bd-a7af-9b70cd598b05" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.514140] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6951f012-9730-40bd-a7af-9b70cd598b05" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.514325] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.514440] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.514501] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.514750] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.514840] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.514935] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6951f012-9730-40bd-a7af-9b70cd598b05',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 656.794683] env[65306]: INFO networking_nsxv3.common.synchronization [req-b20f0341-14ad-4974-a6ee-01fe9450eb46 req-e2b7421c-d64b-439f-bcce-e7d1f44d82dd tempest-ServerExternalEventsTest-893176434 tempest-ServerExternalEventsTest-893176434-project-member] Enqueued Resource ID: 5188a191-fc4a-4216-b94f-2b854c8abd88 with Priority: HIGHEST for action security_group_members [ 656.795541] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5188a191-fc4a-4216-b94f-2b854c8abd88 with Priority: HIGHEST for action security_group_members [ 656.796189] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-5188a191-fc4a-4216-b94f-2b854c8abd88 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.796189] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5188a191-fc4a-4216-b94f-2b854c8abd88" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.796189] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5188a191-fc4a-4216-b94f-2b854c8abd88" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.796646] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5188a191-fc4a-4216-b94f-2b854c8abd88" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.796646] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.796646] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.796646] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.796991] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.796991] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.797721] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5188a191-fc4a-4216-b94f-2b854c8abd88',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 656.817472] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-6e403189-fcac-40e3-aa50-4c17f4d29895 taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.817472] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6e403189-fcac-40e3-aa50-4c17f4d29895" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.817626] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6e403189-fcac-40e3-aa50-4c17f4d29895',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 656.820721] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 57f05d3b-3b02-4eec-864a-a0857c696d40 with status ACTIVE [ 656.820721] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.820721] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.820721] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.820721] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.820721] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.820721] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.820721] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.820721] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.820721] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.820721] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.821310] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.821310] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.821310] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.821310] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.821442] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.821442] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 57f05d3b-3b02-4eec-864a-a0857c696d40 is going to be updated. [ 656.849383] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.849633] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.849704] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.849959] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.851024] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.851024] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-57f05d3b-3b02-4eec-864a-a0857c696d40" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.023171] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6951f012-9730-40bd-a7af-9b70cd598b05',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 657.301348] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.301515] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.301609] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.301803] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.302120] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.302344] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.302464] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.302591] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.302667] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.302725] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.302834] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5188a191-fc4a-4216-b94f-2b854c8abd88 is going to be updated. [ 657.323031] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6e403189-fcac-40e3-aa50-4c17f4d29895',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 657.339893] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.340136] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.340136] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.340293] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.340428] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.352888] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5188a191-fc4a-4216-b94f-2b854c8abd88 in Status: IN_PROGRESS for 2s [ 657.356119] env[65306]: INFO networking_nsxv3.common.synchronization [req-666b73a7-8ab5-4653-8b16-6e17aedccc2c req-7214075c-da44-4852-acf2-fc0f53cbb25c tempest-AttachInterfacesUnderV243Test-82564794 tempest-AttachInterfacesUnderV243Test-82564794-project-member] Enqueued Resource ID: 30524546-2ed3-474c-bf2b-fc6aff50dfec with Priority: HIGHEST for action security_group_members [ 657.356657] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 30524546-2ed3-474c-bf2b-fc6aff50dfec with Priority: HIGHEST for action security_group_members [ 657.357050] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-30524546-2ed3-474c-bf2b-fc6aff50dfec taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.357184] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-30524546-2ed3-474c-bf2b-fc6aff50dfec" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.357247] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-30524546-2ed3-474c-bf2b-fc6aff50dfec" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.357490] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-30524546-2ed3-474c-bf2b-fc6aff50dfec" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.357651] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.357759] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.357825] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.357991] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.358113] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.358209] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('30524546-2ed3-474c-bf2b-fc6aff50dfec',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 657.527218] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6951f012-9730-40bd-a7af-9b70cd598b05',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 657.746696] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock network-376 taken with stack trace [, , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.746916] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "network-376" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.747082] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "network-376" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.747399] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "network-376" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.747786] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.747894] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.747938] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.748415] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.748415] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.748538] env[65306]: DEBUG dogpile.cache.region [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] No value present for key: 'zone-id' {{(pid=65306) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 657.748538] env[65306]: DEBUG dogpile.lock [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] NeedRegenerationException {{(pid=65306) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 657.748650] env[65306]: DEBUG dogpile.lock [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] no value, waiting for create lock {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 657.748757] env[65306]: DEBUG dogpile.lock [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] value creation lock acquired {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 657.748830] env[65306]: DEBUG dogpile.cache.region [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] No value present for key: 'zone-id' {{(pid=65306) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 657.749050] env[65306]: DEBUG dogpile.lock [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Calling creation function for not-yet-present value {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 657.749289] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 657.770309] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 657.770508] env[65306]: DEBUG dogpile.cache.region [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65306) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 657.770641] env[65306]: DEBUG dogpile.lock [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Released creation lock {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 657.770812] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "network-376" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.771233] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock port-c9f5e340-cd10-4011-b7e7-487fee143966 taken with stack trace [, , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.771435] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "port-c9f5e340-cd10-4011-b7e7-487fee143966" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.771551] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "port-c9f5e340-cd10-4011-b7e7-487fee143966" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.771858] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "port-c9f5e340-cd10-4011-b7e7-487fee143966" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.772015] env[65306]: DEBUG networking_nsxv3.api.rpc [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c9f5e340-cd10-4011-b7e7-487fee143966',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 657.824769] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.825053] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.826331] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.826583] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.826682] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.826795] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6e403189-fcac-40e3-aa50-4c17f4d29895 is going to be created. [ 657.852295] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.852643] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.852869] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.853231] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.853701] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.861964] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.861964] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.861964] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.861964] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.861964] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.861964] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.861964] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.861964] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.861964] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.861964] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.861964] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 30524546-2ed3-474c-bf2b-fc6aff50dfec already deleted. [ 657.861964] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-30524546-2ed3-474c-bf2b-fc6aff50dfec" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.865213] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6e403189-fcac-40e3-aa50-4c17f4d29895 in Status: UNINITIALIZED for 2s [ 657.948646] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 70b8bb37-9445-4339-82b5-ebb24bd0be78 in Status: SUCCESS [ 657.948904] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-70b8bb37-9445-4339-82b5-ebb24bd0be78" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.949599] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-70b8bb37-9445-4339-82b5-ebb24bd0be78" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.949599] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-70b8bb37-9445-4339-82b5-ebb24bd0be78" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.949599] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.949938] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.949938] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.950118] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.950194] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.950235] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-70b8bb37-9445-4339-82b5-ebb24bd0be78" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.950307] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('70b8bb37-9445-4339-82b5-ebb24bd0be78',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 658.029711] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.029711] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.029957] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.031030] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.031030] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.031030] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6951f012-9730-40bd-a7af-9b70cd598b05 is going to be updated. [ 658.130848] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.131035] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.131084] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.131290] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.131437] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.142347] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6951f012-9730-40bd-a7af-9b70cd598b05 in Status: IN_PROGRESS for 2s [ 658.275753] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.276126] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.276362] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.276739] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.276947] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.277193] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Segment Port c9f5e340-cd10-4011-b7e7-487fee143966 not found, creating... [ 658.277609] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.277861] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.278115] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.278503] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.278703] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.279122] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.279374] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.279557] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.279855] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.280070] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.280286] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Resource: SegmentPort with ID: c9f5e340-cd10-4011-b7e7-487fee143966 is going to be created. [ 658.309290] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.309463] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.309513] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.309771] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.310081] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.310376] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "port-c9f5e340-cd10-4011-b7e7-487fee143966" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.456042] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-70b8bb37-9445-4339-82b5-ebb24bd0be78 taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.456381] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-70b8bb37-9445-4339-82b5-ebb24bd0be78" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.456994] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-70b8bb37-9445-4339-82b5-ebb24bd0be78" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.456994] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-70b8bb37-9445-4339-82b5-ebb24bd0be78" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.457288] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.457416] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.457485] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.458255] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.458255] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.458402] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-70b8bb37-9445-4339-82b5-ebb24bd0be78" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.458439] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-70b8bb37-9445-4339-82b5-ebb24bd0be78 taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.458717] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-70b8bb37-9445-4339-82b5-ebb24bd0be78" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.458717] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-70b8bb37-9445-4339-82b5-ebb24bd0be78" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.458972] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-70b8bb37-9445-4339-82b5-ebb24bd0be78" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.458972] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.458972] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.459104] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.459200] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.459236] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.459319] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-70b8bb37-9445-4339-82b5-ebb24bd0be78" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.459416] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('70b8bb37-9445-4339-82b5-ebb24bd0be78',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 658.864119] env[65306]: INFO networking_nsxv3.common.synchronization [None req-34440ce4-53a1-407f-b02a-69ffd097b1b2 None None] Enqueued Resource ID: c81c793e-61dd-44a7-b75e-b2c058fda81a with Priority: HIGHEST for action port [ 658.865052] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c81c793e-61dd-44a7-b75e-b2c058fda81a with Priority: HIGHEST for action port [ 658.866192] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock port-c81c793e-61dd-44a7-b75e-b2c058fda81a taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.866192] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c81c793e-61dd-44a7-b75e-b2c058fda81a" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.866192] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c81c793e-61dd-44a7-b75e-b2c058fda81a" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.866580] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c81c793e-61dd-44a7-b75e-b2c058fda81a" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.866742] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c81c793e-61dd-44a7-b75e-b2c058fda81a',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 658.963684] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 70b8bb37-9445-4339-82b5-ebb24bd0be78: rpc.has_security_group_logging(os_id): False [ 658.986550] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.986550] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.986550] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.986550] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.986550] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.986550] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.986550] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.986550] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.986550] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.986550] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.986550] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.986550] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.986550] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.986550] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.986550] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.987317] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.987317] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.987317] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.987317] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.987317] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.987317] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 70b8bb37-9445-4339-82b5-ebb24bd0be78 is going to be updated. [ 659.087660] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.087832] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.087916] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.088118] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.088262] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.113860] env[65306]: INFO networking_nsxv3.common.synchronization [req-666b73a7-8ab5-4653-8b16-6e17aedccc2c req-5dec2178-b46f-485d-9035-92fbffd8640a service nova] Enqueued Resource ID: 30524546-2ed3-474c-bf2b-fc6aff50dfec with Priority: HIGHEST for action security_group_rules [ 659.113860] env[65306]: INFO networking_nsxv3.common.synchronization [req-666b73a7-8ab5-4653-8b16-6e17aedccc2c req-5dec2178-b46f-485d-9035-92fbffd8640a service nova] Enqueued Resource ID: 30524546-2ed3-474c-bf2b-fc6aff50dfec with Priority: HIGHEST for action security_group_members [ 659.113860] env[65306]: INFO networking_nsxv3.common.synchronization [req-666b73a7-8ab5-4653-8b16-6e17aedccc2c req-5dec2178-b46f-485d-9035-92fbffd8640a service nova] Enqueued Resource ID: c9f5e340-cd10-4011-b7e7-487fee143966 with Priority: HIGHEST for action port [ 659.113860] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 30524546-2ed3-474c-bf2b-fc6aff50dfec with Priority: HIGHEST for action security_group_rules [ 659.113860] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 30524546-2ed3-474c-bf2b-fc6aff50dfec with Priority: HIGHEST for action security_group_members [ 659.113860] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c9f5e340-cd10-4011-b7e7-487fee143966 with Priority: HIGHEST for action port [ 659.114344] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock rules-30524546-2ed3-474c-bf2b-fc6aff50dfec taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.114815] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-30524546-2ed3-474c-bf2b-fc6aff50dfec" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.114886] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-30524546-2ed3-474c-bf2b-fc6aff50dfec" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.115109] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-30524546-2ed3-474c-bf2b-fc6aff50dfec" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.115185] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('30524546-2ed3-474c-bf2b-fc6aff50dfec',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 659.116124] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-30524546-2ed3-474c-bf2b-fc6aff50dfec taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.116856] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-30524546-2ed3-474c-bf2b-fc6aff50dfec" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.116856] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-30524546-2ed3-474c-bf2b-fc6aff50dfec" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.116856] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-30524546-2ed3-474c-bf2b-fc6aff50dfec" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.116856] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.117224] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.117264] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.118228] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.118228] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.118228] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('30524546-2ed3-474c-bf2b-fc6aff50dfec',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 659.120654] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock port-c9f5e340-cd10-4011-b7e7-487fee143966 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.120654] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c9f5e340-cd10-4011-b7e7-487fee143966" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.120654] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c9f5e340-cd10-4011-b7e7-487fee143966" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.120654] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c9f5e340-cd10-4011-b7e7-487fee143966" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.120654] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c9f5e340-cd10-4011-b7e7-487fee143966',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 659.121868] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 70b8bb37-9445-4339-82b5-ebb24bd0be78 in Status: IN_PROGRESS for 2s [ 659.368201] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5188a191-fc4a-4216-b94f-2b854c8abd88 in Status: SUCCESS [ 659.368277] env[65306]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5188a191-fc4a-4216-b94f-2b854c8abd88 deletion is rescheduled due to dependency. [ 659.368367] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5188a191-fc4a-4216-b94f-2b854c8abd88" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.371882] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c81c793e-61dd-44a7-b75e-b2c058fda81a [ 659.374244] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.374440] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.374662] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.375093] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.375604] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.375812] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c81c793e-61dd-44a7-b75e-b2c058fda81a already deleted. [ 659.376320] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c81c793e-61dd-44a7-b75e-b2c058fda81a" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.625059] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-30524546-2ed3-474c-bf2b-fc6aff50dfec taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.625059] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-30524546-2ed3-474c-bf2b-fc6aff50dfec" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.625059] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('30524546-2ed3-474c-bf2b-fc6aff50dfec',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 659.625322] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c9f5e340-cd10-4011-b7e7-487fee143966 with status ACTIVE [ 659.625686] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.625686] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.625686] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.625921] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.625921] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.626142] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.626249] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.626439] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.626646] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.626728] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.626939] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.627319] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.627401] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.627555] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.627633] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.627724] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c9f5e340-cd10-4011-b7e7-487fee143966 is going to be updated. [ 659.651674] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.651826] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.651889] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.653276] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.653434] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.653621] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c9f5e340-cd10-4011-b7e7-487fee143966" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.877992] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6e403189-fcac-40e3-aa50-4c17f4d29895 in Status: SUCCESS [ 659.881080] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6e403189-fcac-40e3-aa50-4c17f4d29895" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.881080] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6e403189-fcac-40e3-aa50-4c17f4d29895" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.881080] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6e403189-fcac-40e3-aa50-4c17f4d29895" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.881080] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.881080] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.881080] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.881080] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.881080] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.881080] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6e403189-fcac-40e3-aa50-4c17f4d29895" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.881080] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6e403189-fcac-40e3-aa50-4c17f4d29895',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 660.130959] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('30524546-2ed3-474c-bf2b-fc6aff50dfec',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 660.159120] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6951f012-9730-40bd-a7af-9b70cd598b05 in Status: SUCCESS [ 660.159120] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6951f012-9730-40bd-a7af-9b70cd598b05" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.382867] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6e403189-fcac-40e3-aa50-4c17f4d29895',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 660.458666] env[65306]: INFO networking_nsxv3.common.synchronization [None req-6487f5db-32a4-4827-ae8a-4fe2226ee1a9 tempest-ServersTestManualDisk-1886184172 tempest-ServersTestManualDisk-1886184172-project-member] Enqueued Resource ID: 3d7e63c8-5b54-4e8c-889b-658da24748dc with Priority: HIGHEST for action security_group_rules [ 660.459283] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3d7e63c8-5b54-4e8c-889b-658da24748dc with Priority: HIGHEST for action security_group_rules [ 660.461352] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3d7e63c8-5b54-4e8c-889b-658da24748dc taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.461352] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3d7e63c8-5b54-4e8c-889b-658da24748dc" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.461352] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3d7e63c8-5b54-4e8c-889b-658da24748dc" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.461352] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3d7e63c8-5b54-4e8c-889b-658da24748dc" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.461352] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3d7e63c8-5b54-4e8c-889b-658da24748dc',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 660.633402] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.633686] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.633686] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.634142] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.634208] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.634334] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 30524546-2ed3-474c-bf2b-fc6aff50dfec is going to be created. [ 660.661015] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.661195] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.661289] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.661519] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.661682] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.674985] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 30524546-2ed3-474c-bf2b-fc6aff50dfec in Status: UNINITIALIZED for 2s [ 660.878303] env[65306]: INFO networking_nsxv3.common.synchronization [None req-11d4ac64-424b-4b8f-aa5e-73f7299f258c tempest-ServersTestManualDisk-1886184172 tempest-ServersTestManualDisk-1886184172-project-member] Enqueued Resource ID: 3d7e63c8-5b54-4e8c-889b-658da24748dc with Priority: HIGHEST for action security_group_rules [ 660.878860] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3d7e63c8-5b54-4e8c-889b-658da24748dc with Priority: HIGHEST for action security_group_rules [ 660.879376] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3d7e63c8-5b54-4e8c-889b-658da24748dc taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.879508] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3d7e63c8-5b54-4e8c-889b-658da24748dc" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.885358] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6e403189-fcac-40e3-aa50-4c17f4d29895: rpc.has_security_group_logging(os_id): False [ 660.906285] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.906467] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.906514] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.906712] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.906833] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.907150] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.907304] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.907381] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.907577] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.907726] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.908172] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6e403189-fcac-40e3-aa50-4c17f4d29895 is going to be created. [ 660.977187] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.977349] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.977450] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.977670] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.977853] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.988769] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.988769] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.988769] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.988769] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.988769] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.988769] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3d7e63c8-5b54-4e8c-889b-658da24748dc already deleted. [ 660.988769] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3d7e63c8-5b54-4e8c-889b-658da24748dc" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.988769] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3d7e63c8-5b54-4e8c-889b-658da24748dc" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.988769] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3d7e63c8-5b54-4e8c-889b-658da24748dc" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.989383] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3d7e63c8-5b54-4e8c-889b-658da24748dc',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 660.992231] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6e403189-fcac-40e3-aa50-4c17f4d29895 in Status: IN_PROGRESS for 2s [ 661.136972] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 70b8bb37-9445-4339-82b5-ebb24bd0be78 in Status: SUCCESS [ 661.137391] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-70b8bb37-9445-4339-82b5-ebb24bd0be78" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.454115] env[65306]: INFO networking_nsxv3.common.synchronization [req-58b15750-1ca6-4a77-b190-3d30475db0bf req-b8547551-8efd-4477-b537-5ca6765919ee tempest-ServersTestMultiNic-959517935 tempest-ServersTestMultiNic-959517935-project-member] Enqueued Resource ID: f5174f7c-dc12-4dad-9284-eed34d64b830 with Priority: HIGHEST for action security_group_members [ 661.455503] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f5174f7c-dc12-4dad-9284-eed34d64b830 with Priority: HIGHEST for action security_group_members [ 661.455503] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-f5174f7c-dc12-4dad-9284-eed34d64b830 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.455503] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f5174f7c-dc12-4dad-9284-eed34d64b830" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.455503] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f5174f7c-dc12-4dad-9284-eed34d64b830" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.455685] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f5174f7c-dc12-4dad-9284-eed34d64b830" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.457033] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.457033] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.457033] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.457033] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.457033] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.457033] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f5174f7c-dc12-4dad-9284-eed34d64b830',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 661.511234] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.511403] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.511474] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.511689] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.511776] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.511886] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3d7e63c8-5b54-4e8c-889b-658da24748dc already deleted. [ 661.511966] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3d7e63c8-5b54-4e8c-889b-658da24748dc" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.959350] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.959709] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.959709] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.960105] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.960402] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.960752] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.960945] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.961073] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.961341] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.961466] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.961621] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f5174f7c-dc12-4dad-9284-eed34d64b830 already deleted. [ 661.961783] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f5174f7c-dc12-4dad-9284-eed34d64b830" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.689024] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 30524546-2ed3-474c-bf2b-fc6aff50dfec in Status: SUCCESS [ 662.689024] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-30524546-2ed3-474c-bf2b-fc6aff50dfec" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.689024] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-30524546-2ed3-474c-bf2b-fc6aff50dfec" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.689024] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-30524546-2ed3-474c-bf2b-fc6aff50dfec" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.689024] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.689024] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.689024] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.689024] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.689024] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.689024] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-30524546-2ed3-474c-bf2b-fc6aff50dfec" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.689024] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('30524546-2ed3-474c-bf2b-fc6aff50dfec',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 662.697056] env[65306]: INFO networking_nsxv3.common.synchronization [req-58b15750-1ca6-4a77-b190-3d30475db0bf req-10d5377f-a6c8-40b8-898e-7cf9840150af tempest-ServersTestMultiNic-959517935 tempest-ServersTestMultiNic-959517935-project-member] Enqueued Resource ID: f5174f7c-dc12-4dad-9284-eed34d64b830 with Priority: HIGHEST for action security_group_members [ 662.697056] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f5174f7c-dc12-4dad-9284-eed34d64b830 with Priority: HIGHEST for action security_group_members [ 662.698469] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-f5174f7c-dc12-4dad-9284-eed34d64b830 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.698469] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f5174f7c-dc12-4dad-9284-eed34d64b830" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.698469] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f5174f7c-dc12-4dad-9284-eed34d64b830" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.698469] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f5174f7c-dc12-4dad-9284-eed34d64b830" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.698469] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.698469] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.698469] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.698469] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.698469] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.698469] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f5174f7c-dc12-4dad-9284-eed34d64b830',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 663.005882] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6e403189-fcac-40e3-aa50-4c17f4d29895 in Status: SUCCESS [ 663.006206] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6e403189-fcac-40e3-aa50-4c17f4d29895" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.113281] env[65306]: INFO networking_nsxv3.common.synchronization [None req-4cca9735-3f83-42c7-ae70-f94e1c767457 None None] Enqueued Resource ID: d8fb5223-a189-415f-8b4d-926927845832 with Priority: HIGHEST for action port [ 663.113538] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d8fb5223-a189-415f-8b4d-926927845832 with Priority: HIGHEST for action port [ 663.114125] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock port-d8fb5223-a189-415f-8b4d-926927845832 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.114316] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d8fb5223-a189-415f-8b4d-926927845832" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.114359] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d8fb5223-a189-415f-8b4d-926927845832" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.114886] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d8fb5223-a189-415f-8b4d-926927845832" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.114886] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d8fb5223-a189-415f-8b4d-926927845832',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 663.191197] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('30524546-2ed3-474c-bf2b-fc6aff50dfec',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 663.200693] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.200865] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.200919] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.201128] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.201224] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.201427] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.201965] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.201965] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.201965] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.201965] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.201965] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f5174f7c-dc12-4dad-9284-eed34d64b830 already deleted. [ 663.202263] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f5174f7c-dc12-4dad-9284-eed34d64b830" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.317826] env[65306]: INFO networking_nsxv3.common.synchronization [None req-d1c83496-bd72-4813-9183-c4fd9173eb85 None None] Enqueued Resource ID: 18811a76-b457-42c0-8932-07a4dde7fd29 with Priority: HIGHEST for action port [ 663.318019] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 18811a76-b457-42c0-8932-07a4dde7fd29 with Priority: HIGHEST for action port [ 663.318604] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock port-18811a76-b457-42c0-8932-07a4dde7fd29 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.318739] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-18811a76-b457-42c0-8932-07a4dde7fd29" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.318810] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-18811a76-b457-42c0-8932-07a4dde7fd29" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.319317] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-18811a76-b457-42c0-8932-07a4dde7fd29" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.319317] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('18811a76-b457-42c0-8932-07a4dde7fd29',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 663.617979] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d8fb5223-a189-415f-8b4d-926927845832 [ 663.617979] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.618187] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.618287] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.618535] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.618659] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.618785] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d8fb5223-a189-415f-8b4d-926927845832 already deleted. [ 663.618896] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d8fb5223-a189-415f-8b4d-926927845832" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.693535] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 30524546-2ed3-474c-bf2b-fc6aff50dfec: rpc.has_security_group_logging(os_id): False [ 663.716044] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.716044] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.716044] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.716044] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.716301] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.716364] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.716465] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.716533] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.716690] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.716772] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.717716] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 30524546-2ed3-474c-bf2b-fc6aff50dfec is going to be created. [ 663.780099] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.780298] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.780357] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.780550] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.780736] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.798099] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 30524546-2ed3-474c-bf2b-fc6aff50dfec in Status: IN_PROGRESS for 2s [ 663.821782] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 18811a76-b457-42c0-8932-07a4dde7fd29 [ 663.821782] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.822445] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.822445] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.823131] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.823227] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.823477] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:18811a76-b457-42c0-8932-07a4dde7fd29 already deleted. [ 663.823477] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-18811a76-b457-42c0-8932-07a4dde7fd29" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.179563] env[65306]: INFO networking_nsxv3.common.synchronization [req-58b15750-1ca6-4a77-b190-3d30475db0bf req-8ef8111c-ea27-4e44-8aa6-9bf57c132a05 tempest-ServersTestMultiNic-959517935 tempest-ServersTestMultiNic-959517935-project-member] Enqueued Resource ID: f5174f7c-dc12-4dad-9284-eed34d64b830 with Priority: HIGHEST for action security_group_members [ 664.180547] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f5174f7c-dc12-4dad-9284-eed34d64b830 with Priority: HIGHEST for action security_group_members [ 664.180641] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-f5174f7c-dc12-4dad-9284-eed34d64b830 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.180772] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f5174f7c-dc12-4dad-9284-eed34d64b830" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.180841] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f5174f7c-dc12-4dad-9284-eed34d64b830" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.181057] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f5174f7c-dc12-4dad-9284-eed34d64b830" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.181214] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.181359] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.181431] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.181588] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.181897] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.181897] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f5174f7c-dc12-4dad-9284-eed34d64b830',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 664.684296] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.684502] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.684502] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.684747] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.684814] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.685029] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.685220] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.685220] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.685345] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.685397] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.685503] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f5174f7c-dc12-4dad-9284-eed34d64b830 already deleted. [ 664.685585] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f5174f7c-dc12-4dad-9284-eed34d64b830" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.794238] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock network-297 taken with stack trace [, , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.794506] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "network-297" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.794653] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "network-297" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.795060] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "network-297" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.795425] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.795687] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.796155] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.796272] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.796495] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.796780] env[65306]: DEBUG dogpile.cache.region [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] No value present for key: 'zone-id' {{(pid=65306) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 664.796949] env[65306]: DEBUG dogpile.lock [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] NeedRegenerationException {{(pid=65306) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 664.797131] env[65306]: DEBUG dogpile.lock [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] no value, waiting for create lock {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 664.797276] env[65306]: DEBUG dogpile.lock [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] value creation lock acquired {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 664.797445] env[65306]: DEBUG dogpile.cache.region [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] No value present for key: 'zone-id' {{(pid=65306) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 664.797573] env[65306]: DEBUG dogpile.lock [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Calling creation function for not-yet-present value {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 664.797755] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 664.824229] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 664.824404] env[65306]: DEBUG dogpile.cache.region [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=65306) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 664.824529] env[65306]: DEBUG dogpile.lock [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Released creation lock {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 664.824718] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "network-297" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.825614] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock port-9dde413a-cd8f-4d40-bb74-6c4be8befa44 taken with stack trace [, , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.825614] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "port-9dde413a-cd8f-4d40-bb74-6c4be8befa44" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.825614] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "port-9dde413a-cd8f-4d40-bb74-6c4be8befa44" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.825776] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "port-9dde413a-cd8f-4d40-bb74-6c4be8befa44" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.825878] env[65306]: DEBUG networking_nsxv3.api.rpc [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9dde413a-cd8f-4d40-bb74-6c4be8befa44',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 665.332036] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.332036] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.332036] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.332036] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.332036] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.332036] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Segment Port 9dde413a-cd8f-4d40-bb74-6c4be8befa44 not found, creating... [ 665.332036] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.332036] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.332036] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.332036] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.332036] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.333433] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.333872] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.334163] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.334515] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.334789] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.335049] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Resource: SegmentPort with ID: 9dde413a-cd8f-4d40-bb74-6c4be8befa44 is going to be created. [ 665.357134] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.357281] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.358055] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.358055] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.358055] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.358281] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "port-9dde413a-cd8f-4d40-bb74-6c4be8befa44" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.364346] env[65306]: INFO networking_nsxv3.common.synchronization [req-f9f66028-d809-49fc-b3f1-297d69b0e98f req-093e03a6-95e3-4ca5-a8f8-67cb4fc298b1 tempest-MultipleCreateTestJSON-2038963662 tempest-MultipleCreateTestJSON-2038963662-project-member] Enqueued Resource ID: df9d38aa-4663-42d9-8451-f5b81969567d with Priority: HIGHEST for action security_group_members [ 665.364973] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: df9d38aa-4663-42d9-8451-f5b81969567d with Priority: HIGHEST for action security_group_members [ 665.365303] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-df9d38aa-4663-42d9-8451-f5b81969567d taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.365432] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-df9d38aa-4663-42d9-8451-f5b81969567d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.365501] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-df9d38aa-4663-42d9-8451-f5b81969567d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.365754] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-df9d38aa-4663-42d9-8451-f5b81969567d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.365910] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.366157] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.366255] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.366428] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.366518] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.366614] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('df9d38aa-4663-42d9-8451-f5b81969567d',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 665.809249] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 30524546-2ed3-474c-bf2b-fc6aff50dfec in Status: SUCCESS [ 665.809632] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-30524546-2ed3-474c-bf2b-fc6aff50dfec" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.870929] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.870929] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.870929] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.870929] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.870929] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.870929] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.870929] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.870929] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.870929] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.870929] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.870929] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: df9d38aa-4663-42d9-8451-f5b81969567d is going to be updated. [ 665.899123] env[65306]: INFO networking_nsxv3.common.synchronization [None req-6afa0d2b-734a-4474-8010-62a503d017f7 None None] Enqueued Resource ID: 9f12b2e2-a938-45c1-809e-e07e17916b61 with Priority: HIGHEST for action port [ 665.901427] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.901427] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.901427] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.901652] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.901652] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.903861] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9f12b2e2-a938-45c1-809e-e07e17916b61 with Priority: HIGHEST for action port [ 665.904573] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock port-9f12b2e2-a938-45c1-809e-e07e17916b61 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.904715] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9f12b2e2-a938-45c1-809e-e07e17916b61" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.905066] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9f12b2e2-a938-45c1-809e-e07e17916b61" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.905066] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9f12b2e2-a938-45c1-809e-e07e17916b61" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.905207] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9f12b2e2-a938-45c1-809e-e07e17916b61',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 665.915752] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: df9d38aa-4663-42d9-8451-f5b81969567d in Status: IN_PROGRESS for 2s [ 666.138139] env[65306]: INFO networking_nsxv3.common.synchronization [req-58b15750-1ca6-4a77-b190-3d30475db0bf req-ad9fe138-7939-4d0a-907e-92ae02a4534e service nova] Enqueued Resource ID: f5174f7c-dc12-4dad-9284-eed34d64b830 with Priority: HIGHEST for action security_group_rules [ 666.138139] env[65306]: INFO networking_nsxv3.common.synchronization [req-58b15750-1ca6-4a77-b190-3d30475db0bf req-ad9fe138-7939-4d0a-907e-92ae02a4534e service nova] Enqueued Resource ID: f5174f7c-dc12-4dad-9284-eed34d64b830 with Priority: HIGHEST for action security_group_members [ 666.138139] env[65306]: INFO networking_nsxv3.common.synchronization [req-58b15750-1ca6-4a77-b190-3d30475db0bf req-ad9fe138-7939-4d0a-907e-92ae02a4534e service nova] Enqueued Resource ID: 9dde413a-cd8f-4d40-bb74-6c4be8befa44 with Priority: HIGHEST for action port [ 666.138139] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f5174f7c-dc12-4dad-9284-eed34d64b830 with Priority: HIGHEST for action security_group_rules [ 666.138139] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f5174f7c-dc12-4dad-9284-eed34d64b830 with Priority: HIGHEST for action security_group_members [ 666.138139] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9dde413a-cd8f-4d40-bb74-6c4be8befa44 with Priority: HIGHEST for action port [ 666.138139] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f5174f7c-dc12-4dad-9284-eed34d64b830 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.138139] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f5174f7c-dc12-4dad-9284-eed34d64b830" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.138139] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f5174f7c-dc12-4dad-9284-eed34d64b830" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.138139] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f5174f7c-dc12-4dad-9284-eed34d64b830" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.138139] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f5174f7c-dc12-4dad-9284-eed34d64b830',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 666.138826] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-f5174f7c-dc12-4dad-9284-eed34d64b830 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.138907] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f5174f7c-dc12-4dad-9284-eed34d64b830" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.138945] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f5174f7c-dc12-4dad-9284-eed34d64b830" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.139174] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f5174f7c-dc12-4dad-9284-eed34d64b830" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.139335] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.139409] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.139469] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.139656] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.139710] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.139768] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f5174f7c-dc12-4dad-9284-eed34d64b830',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 666.142216] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock port-9dde413a-cd8f-4d40-bb74-6c4be8befa44 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.142792] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9dde413a-cd8f-4d40-bb74-6c4be8befa44" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.142835] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9dde413a-cd8f-4d40-bb74-6c4be8befa44" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.143025] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9dde413a-cd8f-4d40-bb74-6c4be8befa44" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.143099] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9dde413a-cd8f-4d40-bb74-6c4be8befa44',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 666.302380] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock network-561 taken with stack trace [, , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.304114] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "network-561" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.304114] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "network-561" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.304114] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "network-561" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.304114] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.304114] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.304114] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.304114] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.304722] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.305544] env[65306]: DEBUG dogpile.cache.region [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] No value present for key: 'zone-id' {{(pid=65306) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 666.305886] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] NeedRegenerationException {{(pid=65306) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 666.306155] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] no value, waiting for create lock {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 666.306404] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] value creation lock acquired {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 666.306697] env[65306]: DEBUG dogpile.cache.region [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] No value present for key: 'zone-id' {{(pid=65306) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 666.308832] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Calling creation function for not-yet-present value {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 666.308832] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 666.339062] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 666.339062] env[65306]: DEBUG dogpile.cache.region [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Cache value generated in 0.030 seconds for key(s): 'zone-id' {{(pid=65306) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 666.339062] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Released creation lock {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 666.339062] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "network-561" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.339062] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock port-d10d4a17-f92a-4149-8615-0fa88f662604 taken with stack trace [, , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.339062] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "port-d10d4a17-f92a-4149-8615-0fa88f662604" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.339062] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "port-d10d4a17-f92a-4149-8615-0fa88f662604" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.339062] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "port-d10d4a17-f92a-4149-8615-0fa88f662604" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.339062] env[65306]: DEBUG networking_nsxv3.api.rpc [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d10d4a17-f92a-4149-8615-0fa88f662604',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 666.410186] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9f12b2e2-a938-45c1-809e-e07e17916b61 [ 666.410186] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.410186] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.410186] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.410186] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.410478] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.410478] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9f12b2e2-a938-45c1-809e-e07e17916b61 already deleted. [ 666.410478] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9f12b2e2-a938-45c1-809e-e07e17916b61" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.645096] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-f5174f7c-dc12-4dad-9284-eed34d64b830 taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.645096] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f5174f7c-dc12-4dad-9284-eed34d64b830" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.645343] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f5174f7c-dc12-4dad-9284-eed34d64b830',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 666.647315] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9dde413a-cd8f-4d40-bb74-6c4be8befa44 with status ACTIVE [ 666.647315] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.647315] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.647315] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.647315] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.647315] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.647315] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.647315] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.647315] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.647780] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.647780] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.647780] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.647780] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.647780] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.647960] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.647960] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.648473] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9dde413a-cd8f-4d40-bb74-6c4be8befa44 is going to be updated. [ 666.675019] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.675273] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.675356] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.675640] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.675847] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.676203] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9dde413a-cd8f-4d40-bb74-6c4be8befa44" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.843026] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.843389] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.843476] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.843743] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.843892] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.844298] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Segment Port d10d4a17-f92a-4149-8615-0fa88f662604 not found, creating... [ 666.844425] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.844740] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.844740] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.844944] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.845099] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.845666] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.845757] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.845851] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.846200] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.846418] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.846729] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Resource: SegmentPort with ID: d10d4a17-f92a-4149-8615-0fa88f662604 is going to be created. [ 666.879450] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.879887] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.880070] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.881126] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.881126] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.881829] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "port-d10d4a17-f92a-4149-8615-0fa88f662604" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.920373] env[65306]: INFO networking_nsxv3.common.synchronization [req-f9f66028-d809-49fc-b3f1-297d69b0e98f req-e36e8da2-bc95-44bd-b2e3-161a7313bf41 tempest-MultipleCreateTestJSON-2038963662 tempest-MultipleCreateTestJSON-2038963662-project-member] Enqueued Resource ID: df9d38aa-4663-42d9-8451-f5b81969567d with Priority: HIGHEST for action security_group_members [ 666.921563] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: df9d38aa-4663-42d9-8451-f5b81969567d with Priority: HIGHEST for action security_group_members [ 666.921563] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-df9d38aa-4663-42d9-8451-f5b81969567d taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.921828] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-df9d38aa-4663-42d9-8451-f5b81969567d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.150978] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f5174f7c-dc12-4dad-9284-eed34d64b830',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 667.368657] env[65306]: INFO networking_nsxv3.common.synchronization [None req-dc91e97c-dc70-4986-9525-e7ea85931241 None None] Enqueued Resource ID: 3f1d1480-5379-4507-9fc1-2cbf8c231ecf with Priority: HIGHEST for action port [ 667.368657] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3f1d1480-5379-4507-9fc1-2cbf8c231ecf with Priority: HIGHEST for action port [ 667.369102] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock port-3f1d1480-5379-4507-9fc1-2cbf8c231ecf taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.369273] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3f1d1480-5379-4507-9fc1-2cbf8c231ecf" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.369374] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3f1d1480-5379-4507-9fc1-2cbf8c231ecf" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.369648] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3f1d1480-5379-4507-9fc1-2cbf8c231ecf" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.369763] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3f1d1480-5379-4507-9fc1-2cbf8c231ecf',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 667.655562] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.655796] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.655921] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.656219] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.656377] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.656509] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f5174f7c-dc12-4dad-9284-eed34d64b830 is going to be created. [ 667.686384] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.686670] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.686670] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.686895] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.687152] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.699975] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f5174f7c-dc12-4dad-9284-eed34d64b830 in Status: UNINITIALIZED for 2s [ 667.746177] env[65306]: INFO networking_nsxv3.common.synchronization [req-f9f66028-d809-49fc-b3f1-297d69b0e98f req-473d677d-bc86-428c-a86e-cc401e091068 service nova] Enqueued Resource ID: df9d38aa-4663-42d9-8451-f5b81969567d with Priority: HIGHEST for action security_group_rules [ 667.746177] env[65306]: INFO networking_nsxv3.common.synchronization [req-f9f66028-d809-49fc-b3f1-297d69b0e98f req-473d677d-bc86-428c-a86e-cc401e091068 service nova] Enqueued Resource ID: df9d38aa-4663-42d9-8451-f5b81969567d with Priority: HIGHEST for action security_group_members [ 667.746683] env[65306]: INFO networking_nsxv3.common.synchronization [req-f9f66028-d809-49fc-b3f1-297d69b0e98f req-473d677d-bc86-428c-a86e-cc401e091068 service nova] Enqueued Resource ID: d10d4a17-f92a-4149-8615-0fa88f662604 with Priority: HIGHEST for action port [ 667.748252] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: df9d38aa-4663-42d9-8451-f5b81969567d with Priority: HIGHEST for action security_group_rules [ 667.748504] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: df9d38aa-4663-42d9-8451-f5b81969567d with Priority: HIGHEST for action security_group_members [ 667.748618] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d10d4a17-f92a-4149-8615-0fa88f662604 with Priority: HIGHEST for action port [ 667.748833] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock rules-df9d38aa-4663-42d9-8451-f5b81969567d taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.748993] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-df9d38aa-4663-42d9-8451-f5b81969567d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.749119] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-df9d38aa-4663-42d9-8451-f5b81969567d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.749362] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-df9d38aa-4663-42d9-8451-f5b81969567d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.749449] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('df9d38aa-4663-42d9-8451-f5b81969567d',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 667.750467] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-df9d38aa-4663-42d9-8451-f5b81969567d taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.750570] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-df9d38aa-4663-42d9-8451-f5b81969567d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.750686] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock port-d10d4a17-f92a-4149-8615-0fa88f662604 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.752732] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d10d4a17-f92a-4149-8615-0fa88f662604" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.752732] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d10d4a17-f92a-4149-8615-0fa88f662604" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.752732] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d10d4a17-f92a-4149-8615-0fa88f662604" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.753028] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d10d4a17-f92a-4149-8615-0fa88f662604',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 667.872079] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3f1d1480-5379-4507-9fc1-2cbf8c231ecf [ 667.872079] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.872079] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.872079] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.872079] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.872079] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.872079] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3f1d1480-5379-4507-9fc1-2cbf8c231ecf already deleted. [ 667.872079] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3f1d1480-5379-4507-9fc1-2cbf8c231ecf" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.929279] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: df9d38aa-4663-42d9-8451-f5b81969567d in Status: SUCCESS [ 667.929279] env[65306]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: df9d38aa-4663-42d9-8451-f5b81969567d deletion is rescheduled due to dependency. [ 667.929279] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-df9d38aa-4663-42d9-8451-f5b81969567d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.929279] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-df9d38aa-4663-42d9-8451-f5b81969567d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.929279] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-df9d38aa-4663-42d9-8451-f5b81969567d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.929279] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.930127] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.930406] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.930841] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.931333] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.931649] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('df9d38aa-4663-42d9-8451-f5b81969567d',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 667.998901] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock network-969 taken with stack trace [, , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.003022] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "network-969" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.003022] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "network-969" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.003022] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "network-969" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.003022] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.003022] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.003022] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.003022] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.003022] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.003022] env[65306]: DEBUG dogpile.cache.region [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] No value present for key: 'zone-id' {{(pid=65306) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 668.003022] env[65306]: DEBUG dogpile.lock [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] NeedRegenerationException {{(pid=65306) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 668.003022] env[65306]: DEBUG dogpile.lock [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] no value, waiting for create lock {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 668.003904] env[65306]: DEBUG dogpile.lock [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] value creation lock acquired {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 668.003904] env[65306]: DEBUG dogpile.cache.region [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] No value present for key: 'zone-id' {{(pid=65306) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 668.004041] env[65306]: DEBUG dogpile.lock [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Calling creation function for not-yet-present value {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 668.004277] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 668.028964] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 668.028964] env[65306]: DEBUG dogpile.cache.region [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=65306) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 668.029452] env[65306]: DEBUG dogpile.lock [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Released creation lock {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 668.029452] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "network-969" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.030062] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock port-3cfb2e5b-250c-4f37-9f8d-3061df6f7d2b taken with stack trace [, , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.030195] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "port-3cfb2e5b-250c-4f37-9f8d-3061df6f7d2b" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.030323] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "port-3cfb2e5b-250c-4f37-9f8d-3061df6f7d2b" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.031276] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "port-3cfb2e5b-250c-4f37-9f8d-3061df6f7d2b" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.031276] env[65306]: DEBUG networking_nsxv3.api.rpc [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3cfb2e5b-250c-4f37-9f8d-3061df6f7d2b',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 668.263978] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock network-561 taken with stack trace [, , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.263978] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "network-561" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.263978] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "network-561" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.263978] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "network-561" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.263978] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.263978] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.263978] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.263978] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.263978] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.263978] env[65306]: DEBUG dogpile.cache.region [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] No value present for key: 'zone-id' {{(pid=65306) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 668.263978] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] NeedRegenerationException {{(pid=65306) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 668.263978] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] no value, waiting for create lock {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 668.263978] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] value creation lock acquired {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 668.266792] env[65306]: DEBUG dogpile.cache.region [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] No value present for key: 'zone-id' {{(pid=65306) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 668.266792] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Calling creation function for not-yet-present value {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 668.266792] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 668.266792] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 668.266792] env[65306]: DEBUG dogpile.cache.region [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65306) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 668.266792] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Released creation lock {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 668.266792] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "network-561" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.266792] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock port-e005dbee-f9f3-4fae-86a7-e41d33d01f4f taken with stack trace [, , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.266792] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "port-e005dbee-f9f3-4fae-86a7-e41d33d01f4f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.266792] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "port-e005dbee-f9f3-4fae-86a7-e41d33d01f4f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.266792] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "port-e005dbee-f9f3-4fae-86a7-e41d33d01f4f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.266792] env[65306]: DEBUG networking_nsxv3.api.rpc [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e005dbee-f9f3-4fae-86a7-e41d33d01f4f',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 668.266792] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-df9d38aa-4663-42d9-8451-f5b81969567d taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.266792] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-df9d38aa-4663-42d9-8451-f5b81969567d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.266792] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d10d4a17-f92a-4149-8615-0fa88f662604 with status ACTIVE [ 668.268112] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.268112] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.268112] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.268112] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.268112] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.268112] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.268112] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.268112] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.268112] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.268112] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.268112] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.268112] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.268112] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.268112] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.268112] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.268112] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d10d4a17-f92a-4149-8615-0fa88f662604 is going to be updated. [ 668.286481] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.286670] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.286737] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.287230] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.287350] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.287548] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d10d4a17-f92a-4149-8615-0fa88f662604" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.434511] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('df9d38aa-4663-42d9-8451-f5b81969567d',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 668.533801] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.534156] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.534216] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.534481] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.535191] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.535191] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Segment Port 3cfb2e5b-250c-4f37-9f8d-3061df6f7d2b not found, creating... [ 668.535191] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.535403] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.535449] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.536274] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.536274] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.536274] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.536274] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.536491] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.536608] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.536745] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.536883] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Resource: SegmentPort with ID: 3cfb2e5b-250c-4f37-9f8d-3061df6f7d2b is going to be created. [ 668.560044] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.560044] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.560044] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.560428] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.560484] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.560784] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "port-3cfb2e5b-250c-4f37-9f8d-3061df6f7d2b" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.695516] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.695758] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.695869] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.696218] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.696386] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.696544] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Segment Port e005dbee-f9f3-4fae-86a7-e41d33d01f4f not found, creating... [ 668.696798] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.696951] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.697103] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.697334] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.697466] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.698068] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.698068] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.698068] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.698302] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.698343] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.698456] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Resource: SegmentPort with ID: e005dbee-f9f3-4fae-86a7-e41d33d01f4f is going to be created. [ 668.723683] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.723946] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.724085] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.724287] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.724516] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.724747] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "port-e005dbee-f9f3-4fae-86a7-e41d33d01f4f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.937214] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('df9d38aa-4663-42d9-8451-f5b81969567d',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 669.272431] env[65306]: INFO networking_nsxv3.common.synchronization [req-58b15750-1ca6-4a77-b190-3d30475db0bf req-bc76783c-9987-48f6-abab-5277446cc72b service nova] Enqueued Resource ID: f5174f7c-dc12-4dad-9284-eed34d64b830 with Priority: HIGHEST for action security_group_rules [ 669.272431] env[65306]: INFO networking_nsxv3.common.synchronization [req-58b15750-1ca6-4a77-b190-3d30475db0bf req-bc76783c-9987-48f6-abab-5277446cc72b service nova] Enqueued Resource ID: f5174f7c-dc12-4dad-9284-eed34d64b830 with Priority: HIGHEST for action security_group_members [ 669.272910] env[65306]: INFO networking_nsxv3.common.synchronization [req-58b15750-1ca6-4a77-b190-3d30475db0bf req-bc76783c-9987-48f6-abab-5277446cc72b service nova] Enqueued Resource ID: 3cfb2e5b-250c-4f37-9f8d-3061df6f7d2b with Priority: HIGHEST for action port [ 669.273779] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f5174f7c-dc12-4dad-9284-eed34d64b830 with Priority: HIGHEST for action security_group_rules [ 669.274094] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f5174f7c-dc12-4dad-9284-eed34d64b830 with Priority: HIGHEST for action security_group_members [ 669.274337] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3cfb2e5b-250c-4f37-9f8d-3061df6f7d2b with Priority: HIGHEST for action port [ 669.274828] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f5174f7c-dc12-4dad-9284-eed34d64b830 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.275094] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f5174f7c-dc12-4dad-9284-eed34d64b830" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.275415] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-f5174f7c-dc12-4dad-9284-eed34d64b830 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.275702] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f5174f7c-dc12-4dad-9284-eed34d64b830" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.275982] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock port-3cfb2e5b-250c-4f37-9f8d-3061df6f7d2b taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.277026] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3cfb2e5b-250c-4f37-9f8d-3061df6f7d2b" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.277026] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3cfb2e5b-250c-4f37-9f8d-3061df6f7d2b" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.277026] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3cfb2e5b-250c-4f37-9f8d-3061df6f7d2b" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.277026] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3cfb2e5b-250c-4f37-9f8d-3061df6f7d2b',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 669.414308] env[65306]: INFO networking_nsxv3.common.synchronization [req-f9f66028-d809-49fc-b3f1-297d69b0e98f req-40ed5021-e43c-4e8e-89b1-61943e4ae0fc service nova] Enqueued Resource ID: df9d38aa-4663-42d9-8451-f5b81969567d with Priority: HIGHEST for action security_group_rules [ 669.414550] env[65306]: INFO networking_nsxv3.common.synchronization [req-f9f66028-d809-49fc-b3f1-297d69b0e98f req-40ed5021-e43c-4e8e-89b1-61943e4ae0fc service nova] Enqueued Resource ID: df9d38aa-4663-42d9-8451-f5b81969567d with Priority: HIGHEST for action security_group_members [ 669.414974] env[65306]: INFO networking_nsxv3.common.synchronization [req-f9f66028-d809-49fc-b3f1-297d69b0e98f req-40ed5021-e43c-4e8e-89b1-61943e4ae0fc service nova] Enqueued Resource ID: e005dbee-f9f3-4fae-86a7-e41d33d01f4f with Priority: HIGHEST for action port [ 669.415263] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: df9d38aa-4663-42d9-8451-f5b81969567d with Priority: HIGHEST for action security_group_rules [ 669.415399] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: df9d38aa-4663-42d9-8451-f5b81969567d with Priority: HIGHEST for action security_group_members [ 669.415499] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e005dbee-f9f3-4fae-86a7-e41d33d01f4f with Priority: HIGHEST for action port [ 669.416646] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock rules-df9d38aa-4663-42d9-8451-f5b81969567d taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.416772] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-df9d38aa-4663-42d9-8451-f5b81969567d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.417117] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-df9d38aa-4663-42d9-8451-f5b81969567d taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.417231] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-df9d38aa-4663-42d9-8451-f5b81969567d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.417792] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock port-e005dbee-f9f3-4fae-86a7-e41d33d01f4f taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.417916] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e005dbee-f9f3-4fae-86a7-e41d33d01f4f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.418063] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e005dbee-f9f3-4fae-86a7-e41d33d01f4f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.418205] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e005dbee-f9f3-4fae-86a7-e41d33d01f4f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.418291] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e005dbee-f9f3-4fae-86a7-e41d33d01f4f',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 669.442704] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.442704] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.442704] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.442704] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.442704] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.442704] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: df9d38aa-4663-42d9-8451-f5b81969567d is going to be updated. [ 669.473338] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.473649] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.473733] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.473950] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.474158] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.484196] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: df9d38aa-4663-42d9-8451-f5b81969567d in Status: IN_PROGRESS for 2s [ 669.551035] env[65306]: INFO networking_nsxv3.common.synchronization [req-bd28acd2-c5bc-4787-bfc8-4fb49895ca7e req-630b2285-017b-4d0e-a34d-9fefae26b5bc tempest-FloatingIPsAssociationNegativeTestJSON-748270145 tempest-FloatingIPsAssociationNegativeTestJSON-748270145-project-member] Enqueued Resource ID: 46299e31-1097-4753-8f76-35280209d73c with Priority: HIGHEST for action security_group_members [ 669.551674] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 46299e31-1097-4753-8f76-35280209d73c with Priority: HIGHEST for action security_group_members [ 669.551674] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-46299e31-1097-4753-8f76-35280209d73c taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.551848] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-46299e31-1097-4753-8f76-35280209d73c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.551848] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-46299e31-1097-4753-8f76-35280209d73c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.552294] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-46299e31-1097-4753-8f76-35280209d73c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.552874] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.552874] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.552874] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.553046] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.553085] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.553189] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('46299e31-1097-4753-8f76-35280209d73c',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 669.712485] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f5174f7c-dc12-4dad-9284-eed34d64b830 in Status: SUCCESS [ 669.712787] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f5174f7c-dc12-4dad-9284-eed34d64b830" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.712981] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f5174f7c-dc12-4dad-9284-eed34d64b830" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.713224] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f5174f7c-dc12-4dad-9284-eed34d64b830" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.713426] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.713546] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.713613] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.713775] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.713857] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.713943] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f5174f7c-dc12-4dad-9284-eed34d64b830" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.714067] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f5174f7c-dc12-4dad-9284-eed34d64b830',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 669.715927] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f5174f7c-dc12-4dad-9284-eed34d64b830" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.716090] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f5174f7c-dc12-4dad-9284-eed34d64b830" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.716321] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.716472] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.716574] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.716743] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.716821] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.717801] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f5174f7c-dc12-4dad-9284-eed34d64b830',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 669.779303] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3cfb2e5b-250c-4f37-9f8d-3061df6f7d2b with status ACTIVE [ 669.779545] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.779784] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.780026] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.780235] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.780235] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.780381] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.780482] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.780529] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.780688] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.780766] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.780945] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.781052] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.781113] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.781255] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.781317] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.781935] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3cfb2e5b-250c-4f37-9f8d-3061df6f7d2b is going to be updated. [ 669.809083] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.809083] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.809083] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.809083] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.809083] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.809083] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3cfb2e5b-250c-4f37-9f8d-3061df6f7d2b" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.920351] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e005dbee-f9f3-4fae-86a7-e41d33d01f4f with status ACTIVE [ 669.923019] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.923019] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.923019] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.923019] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.923019] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.923019] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.923019] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.923019] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.923019] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.923019] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.923019] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.923019] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.923019] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.924906] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.924906] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.924906] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e005dbee-f9f3-4fae-86a7-e41d33d01f4f is going to be updated. [ 669.951393] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.952059] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.952218] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.952633] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.952633] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.952920] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e005dbee-f9f3-4fae-86a7-e41d33d01f4f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.057816] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.057816] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.057816] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.058221] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.058807] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.058807] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.058807] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.058807] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.059508] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.059615] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.059898] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 46299e31-1097-4753-8f76-35280209d73c is going to be updated. [ 670.095162] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.095619] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.096478] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.096747] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.096907] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.129543] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 46299e31-1097-4753-8f76-35280209d73c in Status: IN_PROGRESS for 2s [ 670.219767] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-f5174f7c-dc12-4dad-9284-eed34d64b830 taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.219986] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f5174f7c-dc12-4dad-9284-eed34d64b830" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.220638] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f5174f7c-dc12-4dad-9284-eed34d64b830',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 670.300974] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock network-297 taken with stack trace [, , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.300974] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "network-297" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.301207] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "network-297" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.301312] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "network-297" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.301674] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.301839] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.301955] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.302188] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.302357] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.302726] env[65306]: DEBUG dogpile.cache.region [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] No value present for key: 'zone-id' {{(pid=65306) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 670.302726] env[65306]: DEBUG dogpile.lock [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] NeedRegenerationException {{(pid=65306) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 670.302859] env[65306]: DEBUG dogpile.lock [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] no value, waiting for create lock {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 670.302905] env[65306]: DEBUG dogpile.lock [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] value creation lock acquired {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 670.303018] env[65306]: DEBUG dogpile.cache.region [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] No value present for key: 'zone-id' {{(pid=65306) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 670.303123] env[65306]: DEBUG dogpile.lock [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Calling creation function for not-yet-present value {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 670.303261] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 670.338703] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 670.338868] env[65306]: DEBUG dogpile.cache.region [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Cache value generated in 0.036 seconds for key(s): 'zone-id' {{(pid=65306) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 670.339069] env[65306]: DEBUG dogpile.lock [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Released creation lock {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 670.339306] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "network-297" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.340569] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock port-20dcd0f8-afb9-41c4-be01-21f55811ebe8 taken with stack trace [, , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.340569] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "port-20dcd0f8-afb9-41c4-be01-21f55811ebe8" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.340569] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "port-20dcd0f8-afb9-41c4-be01-21f55811ebe8" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.340569] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "port-20dcd0f8-afb9-41c4-be01-21f55811ebe8" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.340569] env[65306]: DEBUG networking_nsxv3.api.rpc [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('20dcd0f8-afb9-41c4-be01-21f55811ebe8',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 670.724140] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f5174f7c-dc12-4dad-9284-eed34d64b830',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 670.799726] env[65306]: INFO networking_nsxv3.common.synchronization [req-00d9cfbd-74db-49c9-992a-42bd5f4a1ff4 req-b951706c-7fe0-4bea-8052-3a5edd64c82a tempest-ServerDiagnosticsTest-490615988 tempest-ServerDiagnosticsTest-490615988-project-member] Enqueued Resource ID: a05c132c-ec2c-4f0a-90d8-a619996ad7aa with Priority: HIGHEST for action security_group_members [ 670.800215] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a05c132c-ec2c-4f0a-90d8-a619996ad7aa with Priority: HIGHEST for action security_group_members [ 670.800531] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-a05c132c-ec2c-4f0a-90d8-a619996ad7aa taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.800655] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a05c132c-ec2c-4f0a-90d8-a619996ad7aa" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.800725] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a05c132c-ec2c-4f0a-90d8-a619996ad7aa" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.800979] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a05c132c-ec2c-4f0a-90d8-a619996ad7aa" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.801145] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.801318] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.801318] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.801467] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.801551] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.801655] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a05c132c-ec2c-4f0a-90d8-a619996ad7aa',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 670.843232] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.843408] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.843723] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.843817] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.843972] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.844077] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Segment Port 20dcd0f8-afb9-41c4-be01-21f55811ebe8 not found, creating... [ 670.844452] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.844546] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.844589] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.844953] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.844953] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.845203] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.845352] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.845463] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.845665] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.845791] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.845925] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Resource: SegmentPort with ID: 20dcd0f8-afb9-41c4-be01-21f55811ebe8 is going to be created. [ 670.866425] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.866796] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.866796] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.866995] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.867229] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.868435] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "port-20dcd0f8-afb9-41c4-be01-21f55811ebe8" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.227115] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.227328] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.227397] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.227606] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.227711] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.227796] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f5174f7c-dc12-4dad-9284-eed34d64b830 is going to be updated. [ 671.267555] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.267709] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.267783] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.267999] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.268177] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.278510] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f5174f7c-dc12-4dad-9284-eed34d64b830 in Status: IN_PROGRESS for 2s [ 671.304179] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.304415] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.304489] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.304675] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.304778] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.305061] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.305216] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.305282] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.305497] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.305609] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.305703] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a05c132c-ec2c-4f0a-90d8-a619996ad7aa already deleted. [ 671.305792] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a05c132c-ec2c-4f0a-90d8-a619996ad7aa" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.498021] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: df9d38aa-4663-42d9-8451-f5b81969567d in Status: SUCCESS [ 671.498021] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-df9d38aa-4663-42d9-8451-f5b81969567d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.498021] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-df9d38aa-4663-42d9-8451-f5b81969567d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.498021] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-df9d38aa-4663-42d9-8451-f5b81969567d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.498021] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.498021] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.498021] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.498021] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.498021] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.498021] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('df9d38aa-4663-42d9-8451-f5b81969567d',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 671.560099] env[65306]: INFO networking_nsxv3.common.synchronization [req-58b15750-1ca6-4a77-b190-3d30475db0bf req-0287795b-0fd5-41cf-8a65-71089222ad49 service nova] Enqueued Resource ID: f5174f7c-dc12-4dad-9284-eed34d64b830 with Priority: HIGHEST for action security_group_rules [ 671.560290] env[65306]: INFO networking_nsxv3.common.synchronization [req-58b15750-1ca6-4a77-b190-3d30475db0bf req-0287795b-0fd5-41cf-8a65-71089222ad49 service nova] Enqueued Resource ID: f5174f7c-dc12-4dad-9284-eed34d64b830 with Priority: HIGHEST for action security_group_members [ 671.560423] env[65306]: INFO networking_nsxv3.common.synchronization [req-58b15750-1ca6-4a77-b190-3d30475db0bf req-0287795b-0fd5-41cf-8a65-71089222ad49 service nova] Enqueued Resource ID: 20dcd0f8-afb9-41c4-be01-21f55811ebe8 with Priority: HIGHEST for action port [ 671.560646] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f5174f7c-dc12-4dad-9284-eed34d64b830 with Priority: HIGHEST for action security_group_rules [ 671.560770] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f5174f7c-dc12-4dad-9284-eed34d64b830 with Priority: HIGHEST for action security_group_members [ 671.561861] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 20dcd0f8-afb9-41c4-be01-21f55811ebe8 with Priority: HIGHEST for action port [ 671.561861] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f5174f7c-dc12-4dad-9284-eed34d64b830 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.561861] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f5174f7c-dc12-4dad-9284-eed34d64b830" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.561861] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-f5174f7c-dc12-4dad-9284-eed34d64b830 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.561861] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f5174f7c-dc12-4dad-9284-eed34d64b830" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.562139] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock port-20dcd0f8-afb9-41c4-be01-21f55811ebe8 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.562139] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-20dcd0f8-afb9-41c4-be01-21f55811ebe8" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.562139] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-20dcd0f8-afb9-41c4-be01-21f55811ebe8" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.562316] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-20dcd0f8-afb9-41c4-be01-21f55811ebe8" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.562508] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('20dcd0f8-afb9-41c4-be01-21f55811ebe8',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 671.918020] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock network-707 taken with stack trace [, , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.918020] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "network-707" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.918020] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "network-707" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.918020] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "network-707" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.918020] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.918020] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.918020] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.918896] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.919230] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.919552] env[65306]: DEBUG dogpile.cache.region [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] No value present for key: 'zone-id' {{(pid=65306) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 671.920537] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] NeedRegenerationException {{(pid=65306) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 671.920818] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] no value, waiting for create lock {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 671.921267] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] value creation lock acquired {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 671.921562] env[65306]: DEBUG dogpile.cache.region [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] No value present for key: 'zone-id' {{(pid=65306) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 671.922498] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Calling creation function for not-yet-present value {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 671.922498] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 671.946618] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 671.946929] env[65306]: DEBUG dogpile.cache.region [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=65306) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 671.946929] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Released creation lock {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 671.947082] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "network-707" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.947391] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock port-aef60dc7-4dc5-4bc9-aa5a-46c09bc7b5ca taken with stack trace [, , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.947675] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "port-aef60dc7-4dc5-4bc9-aa5a-46c09bc7b5ca" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.947675] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "port-aef60dc7-4dc5-4bc9-aa5a-46c09bc7b5ca" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.947977] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "port-aef60dc7-4dc5-4bc9-aa5a-46c09bc7b5ca" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.948109] env[65306]: DEBUG networking_nsxv3.api.rpc [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('aef60dc7-4dc5-4bc9-aa5a-46c09bc7b5ca',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 672.000307] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('df9d38aa-4663-42d9-8451-f5b81969567d',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 672.067034] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 20dcd0f8-afb9-41c4-be01-21f55811ebe8 with status ACTIVE [ 672.067228] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.067336] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.067435] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.067753] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.067855] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.068340] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.068340] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.068340] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.068526] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.068606] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.068796] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.068895] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.068950] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.069112] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.069193] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.069276] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 20dcd0f8-afb9-41c4-be01-21f55811ebe8 is going to be updated. [ 672.093363] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.093532] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.093572] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.093766] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.093894] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.094068] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-20dcd0f8-afb9-41c4-be01-21f55811ebe8" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.140802] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 46299e31-1097-4753-8f76-35280209d73c in Status: SUCCESS [ 672.141052] env[65306]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 46299e31-1097-4753-8f76-35280209d73c deletion is rescheduled due to dependency. [ 672.141207] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-46299e31-1097-4753-8f76-35280209d73c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.451108] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.451301] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.451695] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.452128] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.452997] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.453785] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Segment Port aef60dc7-4dc5-4bc9-aa5a-46c09bc7b5ca not found, creating... [ 672.454082] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.454262] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.454377] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.454614] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.454754] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.455240] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.455462] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.455608] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.455867] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.456009] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.456155] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Resource: SegmentPort with ID: aef60dc7-4dc5-4bc9-aa5a-46c09bc7b5ca is going to be created. [ 672.479880] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.480236] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.480355] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.480603] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.480822] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.481183] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "port-aef60dc7-4dc5-4bc9-aa5a-46c09bc7b5ca" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.502080] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('df9d38aa-4663-42d9-8451-f5b81969567d',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 673.005250] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.005848] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.005848] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.005848] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.005848] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.006012] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: df9d38aa-4663-42d9-8451-f5b81969567d is going to be updated. [ 673.040792] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.040961] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.041056] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.041639] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.041876] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.051991] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: df9d38aa-4663-42d9-8451-f5b81969567d in Status: IN_PROGRESS for 2s [ 673.239854] env[65306]: INFO networking_nsxv3.common.synchronization [req-00d9cfbd-74db-49c9-992a-42bd5f4a1ff4 req-73d40a5f-5df8-489f-a857-ad01f1c1fc56 service nova] Enqueued Resource ID: a05c132c-ec2c-4f0a-90d8-a619996ad7aa with Priority: HIGHEST for action security_group_rules [ 673.240039] env[65306]: INFO networking_nsxv3.common.synchronization [req-00d9cfbd-74db-49c9-992a-42bd5f4a1ff4 req-73d40a5f-5df8-489f-a857-ad01f1c1fc56 service nova] Enqueued Resource ID: a05c132c-ec2c-4f0a-90d8-a619996ad7aa with Priority: HIGHEST for action security_group_members [ 673.240200] env[65306]: INFO networking_nsxv3.common.synchronization [req-00d9cfbd-74db-49c9-992a-42bd5f4a1ff4 req-73d40a5f-5df8-489f-a857-ad01f1c1fc56 service nova] Enqueued Resource ID: aef60dc7-4dc5-4bc9-aa5a-46c09bc7b5ca with Priority: HIGHEST for action port [ 673.240778] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a05c132c-ec2c-4f0a-90d8-a619996ad7aa with Priority: HIGHEST for action security_group_rules [ 673.241652] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a05c132c-ec2c-4f0a-90d8-a619996ad7aa with Priority: HIGHEST for action security_group_members [ 673.241652] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aef60dc7-4dc5-4bc9-aa5a-46c09bc7b5ca with Priority: HIGHEST for action port [ 673.241652] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a05c132c-ec2c-4f0a-90d8-a619996ad7aa taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.241652] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a05c132c-ec2c-4f0a-90d8-a619996ad7aa" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.241652] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a05c132c-ec2c-4f0a-90d8-a619996ad7aa" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.242066] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a05c132c-ec2c-4f0a-90d8-a619996ad7aa" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.242293] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a05c132c-ec2c-4f0a-90d8-a619996ad7aa',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 673.243297] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-a05c132c-ec2c-4f0a-90d8-a619996ad7aa taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.243297] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a05c132c-ec2c-4f0a-90d8-a619996ad7aa" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.243431] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a05c132c-ec2c-4f0a-90d8-a619996ad7aa" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.243667] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a05c132c-ec2c-4f0a-90d8-a619996ad7aa" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.243873] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.245835] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.245940] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.246162] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.246162] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.246257] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a05c132c-ec2c-4f0a-90d8-a619996ad7aa',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 673.247367] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock port-aef60dc7-4dc5-4bc9-aa5a-46c09bc7b5ca taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.247367] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-aef60dc7-4dc5-4bc9-aa5a-46c09bc7b5ca" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.247552] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-aef60dc7-4dc5-4bc9-aa5a-46c09bc7b5ca" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.247674] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-aef60dc7-4dc5-4bc9-aa5a-46c09bc7b5ca" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.248408] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('aef60dc7-4dc5-4bc9-aa5a-46c09bc7b5ca',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 673.291384] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f5174f7c-dc12-4dad-9284-eed34d64b830 in Status: SUCCESS [ 673.291681] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f5174f7c-dc12-4dad-9284-eed34d64b830" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.292160] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f5174f7c-dc12-4dad-9284-eed34d64b830" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.292438] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f5174f7c-dc12-4dad-9284-eed34d64b830" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.292735] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.292987] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.293117] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.293336] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.293450] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.293589] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f5174f7c-dc12-4dad-9284-eed34d64b830" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.293816] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-f5174f7c-dc12-4dad-9284-eed34d64b830 taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.294032] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f5174f7c-dc12-4dad-9284-eed34d64b830" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.294032] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f5174f7c-dc12-4dad-9284-eed34d64b830" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.294193] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f5174f7c-dc12-4dad-9284-eed34d64b830" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.294443] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.294443] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.294545] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.294899] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.294899] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.294899] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f5174f7c-dc12-4dad-9284-eed34d64b830" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.294899] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f5174f7c-dc12-4dad-9284-eed34d64b830',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 673.295687] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f5174f7c-dc12-4dad-9284-eed34d64b830" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.295847] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f5174f7c-dc12-4dad-9284-eed34d64b830" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.296010] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.296121] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.296186] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.296325] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.296404] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.296495] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f5174f7c-dc12-4dad-9284-eed34d64b830',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 673.750995] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a05c132c-ec2c-4f0a-90d8-a619996ad7aa',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 673.752303] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-a05c132c-ec2c-4f0a-90d8-a619996ad7aa taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.752639] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a05c132c-ec2c-4f0a-90d8-a619996ad7aa" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.752938] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port aef60dc7-4dc5-4bc9-aa5a-46c09bc7b5ca with status ACTIVE [ 673.753257] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.753507] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.753659] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.753939] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.754146] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.754439] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.754661] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.754834] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.755112] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.755299] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.757066] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.757066] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.757066] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.757066] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.757066] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.757066] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: aef60dc7-4dc5-4bc9-aa5a-46c09bc7b5ca is going to be updated. [ 673.779051] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.779298] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.779408] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.779636] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.779808] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.779988] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-aef60dc7-4dc5-4bc9-aa5a-46c09bc7b5ca" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.798244] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f5174f7c-dc12-4dad-9284-eed34d64b830: rpc.has_security_group_logging(os_id): False [ 673.800194] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f5174f7c-dc12-4dad-9284-eed34d64b830',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 673.819945] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.820231] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.820231] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.820512] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.820636] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.820860] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.820993] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.821094] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.821305] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.821421] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.821681] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.821802] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.821887] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.822165] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.822270] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.822507] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.822628] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.822713] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.822902] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.823017] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.823142] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f5174f7c-dc12-4dad-9284-eed34d64b830 is going to be created. [ 673.903165] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.903452] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.903452] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.903660] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.904205] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.931417] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f5174f7c-dc12-4dad-9284-eed34d64b830 in Status: IN_PROGRESS for 2s [ 674.258612] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a05c132c-ec2c-4f0a-90d8-a619996ad7aa',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 674.302430] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f5174f7c-dc12-4dad-9284-eed34d64b830',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 674.765443] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.765443] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.765443] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.765443] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.765706] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.766534] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a05c132c-ec2c-4f0a-90d8-a619996ad7aa is going to be created. [ 674.805139] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.805139] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.805139] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.805139] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.805139] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.805558] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f5174f7c-dc12-4dad-9284-eed34d64b830 is going to be updated. [ 674.831319] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.831489] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.831655] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.831803] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.832100] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.841609] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a05c132c-ec2c-4f0a-90d8-a619996ad7aa in Status: UNINITIALIZED for 2s [ 674.859779] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.859984] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.859984] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.860390] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.860621] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.891060] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f5174f7c-dc12-4dad-9284-eed34d64b830 in Status: IN_PROGRESS for 2s [ 675.064784] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: df9d38aa-4663-42d9-8451-f5b81969567d in Status: SUCCESS [ 675.064919] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-df9d38aa-4663-42d9-8451-f5b81969567d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.065736] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-df9d38aa-4663-42d9-8451-f5b81969567d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.065736] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-df9d38aa-4663-42d9-8451-f5b81969567d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.065736] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.065736] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.065736] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.066077] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.066077] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.066077] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-df9d38aa-4663-42d9-8451-f5b81969567d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.066202] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('df9d38aa-4663-42d9-8451-f5b81969567d',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 675.069712] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-df9d38aa-4663-42d9-8451-f5b81969567d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.069712] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-df9d38aa-4663-42d9-8451-f5b81969567d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.069712] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.069712] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.069712] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.069712] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.069712] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.070064] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('df9d38aa-4663-42d9-8451-f5b81969567d',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 675.570244] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-df9d38aa-4663-42d9-8451-f5b81969567d taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.570566] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-df9d38aa-4663-42d9-8451-f5b81969567d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.572578] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('df9d38aa-4663-42d9-8451-f5b81969567d',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 675.584251] env[65306]: INFO networking_nsxv3.common.synchronization [None req-3b0a22d6-1074-4c06-b00c-dbdf2248c0fc None None] Enqueued Resource ID: 46e0a695-8e10-4cda-990f-89cecc6bc74e with Priority: HIGHEST for action port [ 675.584251] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 46e0a695-8e10-4cda-990f-89cecc6bc74e with Priority: HIGHEST for action port [ 675.585370] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock port-46e0a695-8e10-4cda-990f-89cecc6bc74e taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.585591] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-46e0a695-8e10-4cda-990f-89cecc6bc74e" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.585684] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-46e0a695-8e10-4cda-990f-89cecc6bc74e" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.585963] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-46e0a695-8e10-4cda-990f-89cecc6bc74e" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.586261] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('46e0a695-8e10-4cda-990f-89cecc6bc74e',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 675.948195] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f5174f7c-dc12-4dad-9284-eed34d64b830 in Status: SUCCESS [ 675.948507] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f5174f7c-dc12-4dad-9284-eed34d64b830" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.948859] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f5174f7c-dc12-4dad-9284-eed34d64b830" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.949381] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f5174f7c-dc12-4dad-9284-eed34d64b830" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.949486] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f5174f7c-dc12-4dad-9284-eed34d64b830',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 676.076955] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('df9d38aa-4663-42d9-8451-f5b81969567d',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 676.090693] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 46e0a695-8e10-4cda-990f-89cecc6bc74e [ 676.091741] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.092200] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.092433] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.093031] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.093031] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.093031] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:46e0a695-8e10-4cda-990f-89cecc6bc74e already deleted. [ 676.093236] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-46e0a695-8e10-4cda-990f-89cecc6bc74e" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.453842] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-f5174f7c-dc12-4dad-9284-eed34d64b830 taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.454398] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f5174f7c-dc12-4dad-9284-eed34d64b830" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.582077] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.582373] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.582373] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.583040] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.583040] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.583040] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: df9d38aa-4663-42d9-8451-f5b81969567d is going to be updated. [ 676.621536] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.621536] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.621536] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.621536] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.621800] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.646704] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: df9d38aa-4663-42d9-8451-f5b81969567d in Status: IN_PROGRESS for 2s [ 676.853716] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a05c132c-ec2c-4f0a-90d8-a619996ad7aa in Status: SUCCESS [ 676.853929] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a05c132c-ec2c-4f0a-90d8-a619996ad7aa" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.854116] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a05c132c-ec2c-4f0a-90d8-a619996ad7aa" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.854326] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a05c132c-ec2c-4f0a-90d8-a619996ad7aa" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.854538] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.854656] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.854724] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.854868] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.854944] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.855043] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a05c132c-ec2c-4f0a-90d8-a619996ad7aa" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.855138] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a05c132c-ec2c-4f0a-90d8-a619996ad7aa',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 676.901977] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f5174f7c-dc12-4dad-9284-eed34d64b830 in Status: SUCCESS [ 676.902264] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f5174f7c-dc12-4dad-9284-eed34d64b830" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.903042] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f5174f7c-dc12-4dad-9284-eed34d64b830" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.903042] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f5174f7c-dc12-4dad-9284-eed34d64b830" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.903042] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.903042] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.903042] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.903371] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.903371] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.903371] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f5174f7c-dc12-4dad-9284-eed34d64b830" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.903550] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f5174f7c-dc12-4dad-9284-eed34d64b830',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 677.123063] env[65306]: INFO networking_nsxv3.common.synchronization [req-b9d5f641-69bc-40a2-953c-513ab8b20871 req-4143173f-82d8-4a86-ba54-7552974f5b1a tempest-ServersTestFqdnHostnames-1995899657 tempest-ServersTestFqdnHostnames-1995899657-project-member] Enqueued Resource ID: 830915ca-b7ed-480d-8dcc-06210706a96a with Priority: HIGHEST for action security_group_members [ 677.124137] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 830915ca-b7ed-480d-8dcc-06210706a96a with Priority: HIGHEST for action security_group_members [ 677.125180] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-830915ca-b7ed-480d-8dcc-06210706a96a taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.125395] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-830915ca-b7ed-480d-8dcc-06210706a96a" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.125480] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-830915ca-b7ed-480d-8dcc-06210706a96a" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.125730] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-830915ca-b7ed-480d-8dcc-06210706a96a" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.125975] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.126073] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.126140] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.126430] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.126430] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.126519] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('830915ca-b7ed-480d-8dcc-06210706a96a',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 677.361174] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-a05c132c-ec2c-4f0a-90d8-a619996ad7aa taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.361360] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a05c132c-ec2c-4f0a-90d8-a619996ad7aa" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.361435] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a05c132c-ec2c-4f0a-90d8-a619996ad7aa" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.361743] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a05c132c-ec2c-4f0a-90d8-a619996ad7aa" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.361954] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.362069] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.362136] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.362311] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.362404] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.362555] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a05c132c-ec2c-4f0a-90d8-a619996ad7aa" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.362653] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-a05c132c-ec2c-4f0a-90d8-a619996ad7aa taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.362778] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a05c132c-ec2c-4f0a-90d8-a619996ad7aa" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.362847] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a05c132c-ec2c-4f0a-90d8-a619996ad7aa" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.363055] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a05c132c-ec2c-4f0a-90d8-a619996ad7aa" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.363325] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.363481] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.363553] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.363718] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.363829] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.364204] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a05c132c-ec2c-4f0a-90d8-a619996ad7aa" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.364302] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a05c132c-ec2c-4f0a-90d8-a619996ad7aa',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 677.407671] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-f5174f7c-dc12-4dad-9284-eed34d64b830 taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.407671] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f5174f7c-dc12-4dad-9284-eed34d64b830" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.407985] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f5174f7c-dc12-4dad-9284-eed34d64b830" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.407985] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f5174f7c-dc12-4dad-9284-eed34d64b830" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.408844] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.408844] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.408844] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.408844] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.408844] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.408844] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f5174f7c-dc12-4dad-9284-eed34d64b830" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.409267] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-f5174f7c-dc12-4dad-9284-eed34d64b830 taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.409267] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f5174f7c-dc12-4dad-9284-eed34d64b830" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.409267] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f5174f7c-dc12-4dad-9284-eed34d64b830" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.409398] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f5174f7c-dc12-4dad-9284-eed34d64b830" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.409434] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.409625] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.409625] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.409768] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.409848] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.409929] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f5174f7c-dc12-4dad-9284-eed34d64b830" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.410028] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f5174f7c-dc12-4dad-9284-eed34d64b830',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 677.629360] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.629764] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.629764] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.631774] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.631909] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.632194] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.632391] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.632466] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.632675] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.632752] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.632878] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 830915ca-b7ed-480d-8dcc-06210706a96a is going to be updated. [ 677.666889] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.669901] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.669901] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.669901] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.669901] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.681720] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 830915ca-b7ed-480d-8dcc-06210706a96a in Status: IN_PROGRESS for 2s [ 677.867515] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a05c132c-ec2c-4f0a-90d8-a619996ad7aa: rpc.has_security_group_logging(os_id): False [ 677.891777] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.891777] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.891777] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.891925] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.891925] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.892235] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.892376] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.892464] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.893051] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.893051] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.893051] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.893283] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.893283] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.893283] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.893378] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.894222] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.894222] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.894222] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.894222] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.894222] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.894222] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a05c132c-ec2c-4f0a-90d8-a619996ad7aa is going to be created. [ 677.914407] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f5174f7c-dc12-4dad-9284-eed34d64b830: rpc.has_security_group_logging(os_id): False [ 677.934554] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.934706] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.934786] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.934979] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.935083] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.935269] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.935473] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.935473] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.935616] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.935659] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.935820] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.935914] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.935974] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.936133] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.936207] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.936901] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.936901] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.936901] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.936901] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.936901] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.936901] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f5174f7c-dc12-4dad-9284-eed34d64b830 is going to be updated. [ 677.967487] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.967487] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.967487] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.967712] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.968572] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.992393] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a05c132c-ec2c-4f0a-90d8-a619996ad7aa in Status: IN_PROGRESS for 2s [ 678.005708] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.006740] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.006967] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.007346] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.007685] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.024450] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f5174f7c-dc12-4dad-9284-eed34d64b830 in Status: IN_PROGRESS for 2s [ 678.659015] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: df9d38aa-4663-42d9-8451-f5b81969567d in Status: SUCCESS [ 678.659636] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-df9d38aa-4663-42d9-8451-f5b81969567d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.659734] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-df9d38aa-4663-42d9-8451-f5b81969567d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.660011] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-df9d38aa-4663-42d9-8451-f5b81969567d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.661363] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.661363] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.661363] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.661363] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.661363] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.661363] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-df9d38aa-4663-42d9-8451-f5b81969567d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.661803] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-df9d38aa-4663-42d9-8451-f5b81969567d taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.661803] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-df9d38aa-4663-42d9-8451-f5b81969567d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.661803] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-df9d38aa-4663-42d9-8451-f5b81969567d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.661998] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-df9d38aa-4663-42d9-8451-f5b81969567d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.662184] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.662372] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.662469] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.662649] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.663038] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.663038] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-df9d38aa-4663-42d9-8451-f5b81969567d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.663187] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('df9d38aa-4663-42d9-8451-f5b81969567d',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 679.167084] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for df9d38aa-4663-42d9-8451-f5b81969567d: rpc.has_security_group_logging(os_id): False [ 679.187548] env[65306]: INFO networking_nsxv3.common.synchronization [None req-81b17049-c399-442c-8b8e-3205504bb48f None None] Enqueued Resource ID: 876cc1c6-d315-49fc-8062-2ee2ed6d41de with Priority: HIGHEST for action port [ 679.190089] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.190592] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.191095] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.192164] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.192428] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.192775] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.193286] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.193494] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.193944] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.194165] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.194738] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.194990] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.195330] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.195834] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.196036] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.196688] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.197060] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.197238] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.197555] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.198114] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.198729] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: df9d38aa-4663-42d9-8451-f5b81969567d is going to be updated. [ 679.200837] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 876cc1c6-d315-49fc-8062-2ee2ed6d41de with Priority: HIGHEST for action port [ 679.201308] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock port-876cc1c6-d315-49fc-8062-2ee2ed6d41de taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.201675] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-876cc1c6-d315-49fc-8062-2ee2ed6d41de" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.201840] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-876cc1c6-d315-49fc-8062-2ee2ed6d41de" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.202171] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-876cc1c6-d315-49fc-8062-2ee2ed6d41de" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.202370] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('876cc1c6-d315-49fc-8062-2ee2ed6d41de',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 679.272517] env[65306]: INFO networking_nsxv3.common.synchronization [None req-7df318a4-45f6-4ea7-b1d6-7cb0c29a5432 None None] Enqueued Resource ID: ead6b606-1a51-4c30-a58a-c7738d2d9b4a with Priority: HIGHEST for action port [ 679.275322] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ead6b606-1a51-4c30-a58a-c7738d2d9b4a with Priority: HIGHEST for action port [ 679.275322] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock port-ead6b606-1a51-4c30-a58a-c7738d2d9b4a taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.275322] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ead6b606-1a51-4c30-a58a-c7738d2d9b4a" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.275322] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ead6b606-1a51-4c30-a58a-c7738d2d9b4a" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.275322] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ead6b606-1a51-4c30-a58a-c7738d2d9b4a" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.275322] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ead6b606-1a51-4c30-a58a-c7738d2d9b4a',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 679.290441] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.290441] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.290441] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.290441] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.290441] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.318354] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: df9d38aa-4663-42d9-8451-f5b81969567d in Status: IN_PROGRESS for 2s [ 679.693616] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 830915ca-b7ed-480d-8dcc-06210706a96a in Status: SUCCESS [ 679.693922] env[65306]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 830915ca-b7ed-480d-8dcc-06210706a96a deletion is rescheduled due to dependency. [ 679.693922] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-830915ca-b7ed-480d-8dcc-06210706a96a" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.704883] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 876cc1c6-d315-49fc-8062-2ee2ed6d41de [ 679.705844] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.705844] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.705844] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.705844] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.705844] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.705844] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:876cc1c6-d315-49fc-8062-2ee2ed6d41de already deleted. [ 679.705844] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-876cc1c6-d315-49fc-8062-2ee2ed6d41de" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.781111] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ead6b606-1a51-4c30-a58a-c7738d2d9b4a [ 679.782125] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.782125] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.782125] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.782125] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.782125] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.782125] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ead6b606-1a51-4c30-a58a-c7738d2d9b4a already deleted. [ 679.782125] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ead6b606-1a51-4c30-a58a-c7738d2d9b4a" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.008737] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a05c132c-ec2c-4f0a-90d8-a619996ad7aa in Status: SUCCESS [ 680.011516] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a05c132c-ec2c-4f0a-90d8-a619996ad7aa" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.039828] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f5174f7c-dc12-4dad-9284-eed34d64b830 in Status: SUCCESS [ 680.040232] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f5174f7c-dc12-4dad-9284-eed34d64b830" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.040394] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f5174f7c-dc12-4dad-9284-eed34d64b830" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.040661] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f5174f7c-dc12-4dad-9284-eed34d64b830" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.040823] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f5174f7c-dc12-4dad-9284-eed34d64b830',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 680.549387] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-f5174f7c-dc12-4dad-9284-eed34d64b830 taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.549387] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f5174f7c-dc12-4dad-9284-eed34d64b830" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.549630] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f5174f7c-dc12-4dad-9284-eed34d64b830" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.549630] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f5174f7c-dc12-4dad-9284-eed34d64b830" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.551320] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.551320] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.551320] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.551320] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.551320] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.551320] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f5174f7c-dc12-4dad-9284-eed34d64b830" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.551320] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f5174f7c-dc12-4dad-9284-eed34d64b830',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 681.055564] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-f5174f7c-dc12-4dad-9284-eed34d64b830 taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.055899] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f5174f7c-dc12-4dad-9284-eed34d64b830" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.055899] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f5174f7c-dc12-4dad-9284-eed34d64b830" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.059218] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f5174f7c-dc12-4dad-9284-eed34d64b830" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.059218] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.059218] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.059218] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.062470] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.062470] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.062470] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f5174f7c-dc12-4dad-9284-eed34d64b830" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.062622] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-f5174f7c-dc12-4dad-9284-eed34d64b830 taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.062708] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f5174f7c-dc12-4dad-9284-eed34d64b830" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.062753] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f5174f7c-dc12-4dad-9284-eed34d64b830" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.062908] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f5174f7c-dc12-4dad-9284-eed34d64b830" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.063073] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.063178] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.063237] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.063407] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.063445] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.063538] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f5174f7c-dc12-4dad-9284-eed34d64b830" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.063602] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f5174f7c-dc12-4dad-9284-eed34d64b830',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 681.339173] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: df9d38aa-4663-42d9-8451-f5b81969567d in Status: SUCCESS [ 681.343072] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-df9d38aa-4663-42d9-8451-f5b81969567d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.343072] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-df9d38aa-4663-42d9-8451-f5b81969567d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.343072] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-df9d38aa-4663-42d9-8451-f5b81969567d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.343072] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('df9d38aa-4663-42d9-8451-f5b81969567d',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 681.568372] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f5174f7c-dc12-4dad-9284-eed34d64b830: rpc.has_security_group_logging(os_id): False [ 681.593094] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.593328] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.594443] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.594746] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.595027] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.595168] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.595321] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.595411] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.595920] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.595920] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.597259] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.597378] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.597585] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.597662] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.597765] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.597966] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.598075] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.598138] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.598294] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.598372] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.598473] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f5174f7c-dc12-4dad-9284-eed34d64b830 is going to be updated. [ 681.680029] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.680029] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.680029] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.680029] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.680029] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.695691] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f5174f7c-dc12-4dad-9284-eed34d64b830 in Status: IN_PROGRESS for 2s [ 681.846644] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-df9d38aa-4663-42d9-8451-f5b81969567d taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.846794] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-df9d38aa-4663-42d9-8451-f5b81969567d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.846869] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-df9d38aa-4663-42d9-8451-f5b81969567d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.847125] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-df9d38aa-4663-42d9-8451-f5b81969567d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.847301] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.847408] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.847474] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.847646] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.847735] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.847825] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-df9d38aa-4663-42d9-8451-f5b81969567d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.847916] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('df9d38aa-4663-42d9-8451-f5b81969567d',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 682.351726] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-df9d38aa-4663-42d9-8451-f5b81969567d taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.355151] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-df9d38aa-4663-42d9-8451-f5b81969567d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.355151] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-df9d38aa-4663-42d9-8451-f5b81969567d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.355151] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-df9d38aa-4663-42d9-8451-f5b81969567d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.355151] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.355151] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.355151] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.355151] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.355151] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.355151] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-df9d38aa-4663-42d9-8451-f5b81969567d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.356166] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-df9d38aa-4663-42d9-8451-f5b81969567d taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.356166] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-df9d38aa-4663-42d9-8451-f5b81969567d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.356166] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-df9d38aa-4663-42d9-8451-f5b81969567d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.356166] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-df9d38aa-4663-42d9-8451-f5b81969567d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.357651] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.357651] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.357651] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.357825] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.357825] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.357917] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-df9d38aa-4663-42d9-8451-f5b81969567d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.358024] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('df9d38aa-4663-42d9-8451-f5b81969567d',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 682.861889] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for df9d38aa-4663-42d9-8451-f5b81969567d: rpc.has_security_group_logging(os_id): False [ 682.885020] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.885020] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.885020] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.885020] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.885020] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.885020] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.885020] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.885020] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.885020] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.885020] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.885020] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.885020] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.885020] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.888741] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.888741] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.888741] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.888741] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.888741] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.888741] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.888741] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.888741] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: df9d38aa-4663-42d9-8451-f5b81969567d is going to be updated. [ 682.955113] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.955313] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.955388] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.955632] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.955782] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.973407] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: df9d38aa-4663-42d9-8451-f5b81969567d in Status: IN_PROGRESS for 2s [ 683.716232] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f5174f7c-dc12-4dad-9284-eed34d64b830 in Status: SUCCESS [ 683.716593] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f5174f7c-dc12-4dad-9284-eed34d64b830" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.275428] env[65306]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 684.275627] env[65306]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 684.991494] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: df9d38aa-4663-42d9-8451-f5b81969567d in Status: SUCCESS [ 684.991494] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-df9d38aa-4663-42d9-8451-f5b81969567d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.282438] env[65306]: INFO networking_nsxv3.common.synchronization [None req-1a49f3b2-90a3-4866-b77e-c81087b5c22b None None] Enqueued Resource ID: 2e2d37a7-ac79-43f0-b043-349932bc443f with Priority: HIGHEST for action port [ 685.284668] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2e2d37a7-ac79-43f0-b043-349932bc443f with Priority: HIGHEST for action port [ 685.287744] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock port-2e2d37a7-ac79-43f0-b043-349932bc443f taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.287744] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2e2d37a7-ac79-43f0-b043-349932bc443f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.287744] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2e2d37a7-ac79-43f0-b043-349932bc443f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.287744] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2e2d37a7-ac79-43f0-b043-349932bc443f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.287744] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2e2d37a7-ac79-43f0-b043-349932bc443f',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 685.574454] env[65306]: INFO networking_nsxv3.common.synchronization [req-376fe852-7e92-42fe-af71-75af2581cb95 req-f0dad9f0-f2d8-4232-887a-d0bbe16f67a4 tempest-DeleteServersAdminTestJSON-721532732 tempest-DeleteServersAdminTestJSON-721532732-project-member] Enqueued Resource ID: 70b8bb37-9445-4339-82b5-ebb24bd0be78 with Priority: HIGHEST for action security_group_members [ 685.575362] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 70b8bb37-9445-4339-82b5-ebb24bd0be78 with Priority: HIGHEST for action security_group_members [ 685.576917] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-70b8bb37-9445-4339-82b5-ebb24bd0be78 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.577183] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-70b8bb37-9445-4339-82b5-ebb24bd0be78" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.577381] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-70b8bb37-9445-4339-82b5-ebb24bd0be78" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.577608] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-70b8bb37-9445-4339-82b5-ebb24bd0be78" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.577826] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.577982] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.578103] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.578519] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.578519] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.578519] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('70b8bb37-9445-4339-82b5-ebb24bd0be78',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 685.788416] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2e2d37a7-ac79-43f0-b043-349932bc443f [ 685.788679] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.788890] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.788890] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.789083] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.789145] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.789246] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2e2d37a7-ac79-43f0-b043-349932bc443f already deleted. [ 685.789323] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2e2d37a7-ac79-43f0-b043-349932bc443f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.082735] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.083052] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.083052] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.083926] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.083926] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.083926] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.083926] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.084178] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.084404] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.084507] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.084666] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 70b8bb37-9445-4339-82b5-ebb24bd0be78 is going to be updated. [ 686.119374] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.119547] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.119622] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.119846] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.120099] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.131877] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 70b8bb37-9445-4339-82b5-ebb24bd0be78 in Status: IN_PROGRESS for 2s [ 687.345452] env[65306]: INFO networking_nsxv3.common.synchronization [None req-eee7f90b-007b-4308-ad3a-e2f3f72dce3e None None] Enqueued Resource ID: cb325fbf-1a79-4237-8571-b7708dbcf47b with Priority: HIGHEST for action port [ 687.345452] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cb325fbf-1a79-4237-8571-b7708dbcf47b with Priority: HIGHEST for action port [ 687.345452] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock port-cb325fbf-1a79-4237-8571-b7708dbcf47b taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.345452] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cb325fbf-1a79-4237-8571-b7708dbcf47b" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.345452] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cb325fbf-1a79-4237-8571-b7708dbcf47b" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.346933] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cb325fbf-1a79-4237-8571-b7708dbcf47b" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.347530] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cb325fbf-1a79-4237-8571-b7708dbcf47b',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 687.851650] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port cb325fbf-1a79-4237-8571-b7708dbcf47b [ 687.851815] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.851892] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.851966] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.852452] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.852987] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.852987] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:cb325fbf-1a79-4237-8571-b7708dbcf47b already deleted. [ 687.852987] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cb325fbf-1a79-4237-8571-b7708dbcf47b" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.144342] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 70b8bb37-9445-4339-82b5-ebb24bd0be78 in Status: SUCCESS [ 688.144623] env[65306]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 70b8bb37-9445-4339-82b5-ebb24bd0be78 deletion is rescheduled due to dependency. [ 688.145028] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-70b8bb37-9445-4339-82b5-ebb24bd0be78" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.361028] env[65306]: INFO networking_nsxv3.common.synchronization [req-1133b57f-e5e7-4f52-b4f1-cdd3c3d2afeb req-6eb83da9-a5b4-41ca-99ea-8664f995dbe6 tempest-MultipleCreateTestJSON-2038963662 tempest-MultipleCreateTestJSON-2038963662-project-member] Enqueued Resource ID: df9d38aa-4663-42d9-8451-f5b81969567d with Priority: HIGHEST for action security_group_members [ 688.364834] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: df9d38aa-4663-42d9-8451-f5b81969567d with Priority: HIGHEST for action security_group_members [ 688.364834] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-df9d38aa-4663-42d9-8451-f5b81969567d taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.364834] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-df9d38aa-4663-42d9-8451-f5b81969567d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.364834] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-df9d38aa-4663-42d9-8451-f5b81969567d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.364834] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-df9d38aa-4663-42d9-8451-f5b81969567d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.364834] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.364834] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.364834] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.364834] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.364834] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.364834] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('df9d38aa-4663-42d9-8451-f5b81969567d',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 688.399356] env[65306]: INFO networking_nsxv3.common.synchronization [req-d0f27909-4fcf-440f-af5d-cb193567d188 req-448004da-4440-4ad4-9ffd-69fe64b244de tempest-ServersTestManualDisk-1886184172 tempest-ServersTestManualDisk-1886184172-project-member] Enqueued Resource ID: 3d7e63c8-5b54-4e8c-889b-658da24748dc with Priority: HIGHEST for action security_group_members [ 688.402461] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3d7e63c8-5b54-4e8c-889b-658da24748dc with Priority: HIGHEST for action security_group_members [ 688.404328] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-3d7e63c8-5b54-4e8c-889b-658da24748dc taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.404422] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3d7e63c8-5b54-4e8c-889b-658da24748dc" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.404471] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3d7e63c8-5b54-4e8c-889b-658da24748dc" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.404905] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3d7e63c8-5b54-4e8c-889b-658da24748dc" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.404905] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.405065] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.405104] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.405266] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.405997] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.405997] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3d7e63c8-5b54-4e8c-889b-658da24748dc',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 688.868178] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('df9d38aa-4663-42d9-8451-f5b81969567d',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 688.894824] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock network-567 taken with stack trace [, , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.895052] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "network-567" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.895174] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "network-567" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.895521] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "network-567" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.895788] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.895967] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.896451] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.897104] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.897269] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.897521] env[65306]: DEBUG dogpile.cache.region [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] No value present for key: 'zone-id' {{(pid=65306) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 688.897656] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] NeedRegenerationException {{(pid=65306) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 688.897844] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] no value, waiting for create lock {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 688.897918] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] value creation lock acquired {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 688.898083] env[65306]: DEBUG dogpile.cache.region [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] No value present for key: 'zone-id' {{(pid=65306) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 688.898219] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Calling creation function for not-yet-present value {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 688.898358] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 688.908347] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.908524] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.908569] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.909781] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.909781] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.909968] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.909968] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.910470] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.910665] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.910760] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.910863] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3d7e63c8-5b54-4e8c-889b-658da24748dc already deleted. [ 688.910951] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3d7e63c8-5b54-4e8c-889b-658da24748dc" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.926088] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 688.926295] env[65306]: DEBUG dogpile.cache.region [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Cache value generated in 0.028 seconds for key(s): 'zone-id' {{(pid=65306) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 688.926415] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Released creation lock {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 688.926605] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "network-567" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.926926] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock port-0aae3625-e7ed-42ca-9210-092140af00ff taken with stack trace [, , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.927147] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "port-0aae3625-e7ed-42ca-9210-092140af00ff" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.927286] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "port-0aae3625-e7ed-42ca-9210-092140af00ff" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.927621] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "port-0aae3625-e7ed-42ca-9210-092140af00ff" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.927762] env[65306]: DEBUG networking_nsxv3.api.rpc [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0aae3625-e7ed-42ca-9210-092140af00ff',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 689.371750] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('df9d38aa-4663-42d9-8451-f5b81969567d',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 689.433142] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.433490] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.433663] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.433970] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.434251] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.434362] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Segment Port 0aae3625-e7ed-42ca-9210-092140af00ff not found, creating... [ 689.434686] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.434877] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.434970] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.435210] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.435373] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.435658] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.435808] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.435923] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.436221] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.436362] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.436497] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Resource: SegmentPort with ID: 0aae3625-e7ed-42ca-9210-092140af00ff is going to be created. [ 689.463922] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.463922] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.463922] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.463922] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.463922] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.465630] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "port-0aae3625-e7ed-42ca-9210-092140af00ff" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.523166] env[65306]: INFO networking_nsxv3.common.synchronization [req-744cbae7-5e00-4ea5-862e-e49ebe2e616a req-a898130c-ff05-41b3-baf6-ede6aa42449e tempest-MultipleCreateTestJSON-2038963662 tempest-MultipleCreateTestJSON-2038963662-project-member] Enqueued Resource ID: df9d38aa-4663-42d9-8451-f5b81969567d with Priority: HIGHEST for action security_group_members [ 689.524388] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: df9d38aa-4663-42d9-8451-f5b81969567d with Priority: HIGHEST for action security_group_members [ 689.524827] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-df9d38aa-4663-42d9-8451-f5b81969567d taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.527899] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-df9d38aa-4663-42d9-8451-f5b81969567d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.874465] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.874695] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.874695] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.874892] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.874987] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.875099] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: df9d38aa-4663-42d9-8451-f5b81969567d is going to be updated. [ 689.917708] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.919038] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.919038] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.919038] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.919038] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.932983] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: df9d38aa-4663-42d9-8451-f5b81969567d in Status: IN_PROGRESS for 2s [ 690.266674] env[65306]: INFO networking_nsxv3.common.synchronization [req-d0f27909-4fcf-440f-af5d-cb193567d188 req-71cec005-7366-4712-a108-7a556d77c711 service nova] Enqueued Resource ID: 3d7e63c8-5b54-4e8c-889b-658da24748dc with Priority: HIGHEST for action security_group_rules [ 690.267230] env[65306]: INFO networking_nsxv3.common.synchronization [req-d0f27909-4fcf-440f-af5d-cb193567d188 req-71cec005-7366-4712-a108-7a556d77c711 service nova] Enqueued Resource ID: 3d7e63c8-5b54-4e8c-889b-658da24748dc with Priority: HIGHEST for action security_group_members [ 690.267230] env[65306]: INFO networking_nsxv3.common.synchronization [req-d0f27909-4fcf-440f-af5d-cb193567d188 req-71cec005-7366-4712-a108-7a556d77c711 service nova] Enqueued Resource ID: 0aae3625-e7ed-42ca-9210-092140af00ff with Priority: HIGHEST for action port [ 690.267540] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3d7e63c8-5b54-4e8c-889b-658da24748dc with Priority: HIGHEST for action security_group_rules [ 690.267696] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3d7e63c8-5b54-4e8c-889b-658da24748dc with Priority: HIGHEST for action security_group_members [ 690.267793] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0aae3625-e7ed-42ca-9210-092140af00ff with Priority: HIGHEST for action port [ 690.268175] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3d7e63c8-5b54-4e8c-889b-658da24748dc taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.268466] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3d7e63c8-5b54-4e8c-889b-658da24748dc" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.268466] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3d7e63c8-5b54-4e8c-889b-658da24748dc" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.268694] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3d7e63c8-5b54-4e8c-889b-658da24748dc" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.268694] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3d7e63c8-5b54-4e8c-889b-658da24748dc',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 690.269991] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-3d7e63c8-5b54-4e8c-889b-658da24748dc taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.270133] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3d7e63c8-5b54-4e8c-889b-658da24748dc" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.270204] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3d7e63c8-5b54-4e8c-889b-658da24748dc" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.270427] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3d7e63c8-5b54-4e8c-889b-658da24748dc" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.270608] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.270703] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.270770] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.270917] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.271018] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.271493] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3d7e63c8-5b54-4e8c-889b-658da24748dc',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 690.274674] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock port-0aae3625-e7ed-42ca-9210-092140af00ff taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.274812] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0aae3625-e7ed-42ca-9210-092140af00ff" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.274859] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0aae3625-e7ed-42ca-9210-092140af00ff" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.275059] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0aae3625-e7ed-42ca-9210-092140af00ff" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.275164] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0aae3625-e7ed-42ca-9210-092140af00ff',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 690.293134] env[65306]: INFO networking_nsxv3.common.synchronization [None req-ee9ce79e-03cb-42f1-ba57-74885adb2817 None None] Enqueued Resource ID: 3ec21d6b-27a9-433e-a787-3302d72e42ae with Priority: HIGHEST for action port [ 690.293134] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3ec21d6b-27a9-433e-a787-3302d72e42ae with Priority: HIGHEST for action port [ 690.294828] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock port-3ec21d6b-27a9-433e-a787-3302d72e42ae taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.294828] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3ec21d6b-27a9-433e-a787-3302d72e42ae" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.294828] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3ec21d6b-27a9-433e-a787-3302d72e42ae" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.295060] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3ec21d6b-27a9-433e-a787-3302d72e42ae" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.295060] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3ec21d6b-27a9-433e-a787-3302d72e42ae',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 690.539462] env[65306]: INFO networking_nsxv3.common.synchronization [req-668ccc36-ca6e-4605-8301-93343ec0b50d req-bcf726b7-6cb0-4064-bf5a-d117b843df41 tempest-ServersTestMultiNic-959517935 tempest-ServersTestMultiNic-959517935-project-member] Enqueued Resource ID: f5174f7c-dc12-4dad-9284-eed34d64b830 with Priority: HIGHEST for action security_group_members [ 690.540054] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f5174f7c-dc12-4dad-9284-eed34d64b830 with Priority: HIGHEST for action security_group_members [ 690.540372] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-f5174f7c-dc12-4dad-9284-eed34d64b830 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.540497] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f5174f7c-dc12-4dad-9284-eed34d64b830" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.540561] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f5174f7c-dc12-4dad-9284-eed34d64b830" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.540769] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f5174f7c-dc12-4dad-9284-eed34d64b830" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.541064] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.541174] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.541174] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.541331] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.541416] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.541510] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f5174f7c-dc12-4dad-9284-eed34d64b830',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 690.775576] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3d7e63c8-5b54-4e8c-889b-658da24748dc',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 690.776766] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-3d7e63c8-5b54-4e8c-889b-658da24748dc taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.776895] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3d7e63c8-5b54-4e8c-889b-658da24748dc" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.780216] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0aae3625-e7ed-42ca-9210-092140af00ff with status ACTIVE [ 690.780456] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.780596] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.780653] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.780860] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.780955] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.781144] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.781242] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.781308] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.781457] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.781534] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.781744] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.781844] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.781908] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.782066] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.782157] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.782244] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0aae3625-e7ed-42ca-9210-092140af00ff is going to be updated. [ 690.797763] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3ec21d6b-27a9-433e-a787-3302d72e42ae [ 690.797974] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.798115] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.798185] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.798388] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.798487] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.798608] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3ec21d6b-27a9-433e-a787-3302d72e42ae already deleted. [ 690.798698] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3ec21d6b-27a9-433e-a787-3302d72e42ae" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.804055] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.804241] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.804334] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.804591] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.804763] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.804929] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0aae3625-e7ed-42ca-9210-092140af00ff" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.820604] env[65306]: INFO networking_nsxv3.common.synchronization [req-668ccc36-ca6e-4605-8301-93343ec0b50d req-da97d9dd-08cc-4b7c-a44c-7ecbc3c9162c tempest-ServersTestMultiNic-959517935 tempest-ServersTestMultiNic-959517935-project-member] Enqueued Resource ID: f5174f7c-dc12-4dad-9284-eed34d64b830 with Priority: HIGHEST for action security_group_members [ 690.824072] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f5174f7c-dc12-4dad-9284-eed34d64b830 with Priority: HIGHEST for action security_group_members [ 690.824072] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-f5174f7c-dc12-4dad-9284-eed34d64b830 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.824072] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f5174f7c-dc12-4dad-9284-eed34d64b830" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.861365] env[65306]: INFO networking_nsxv3.common.synchronization [req-ccff2744-dc6d-475e-8be7-481a7eeac14b req-75f573e4-7f65-47a7-bbee-d806046eb63e tempest-ImagesOneServerNegativeTestJSON-105192947 tempest-ImagesOneServerNegativeTestJSON-105192947-project-member] Enqueued Resource ID: aceee07e-3675-474c-96e8-9fe510f1356f with Priority: HIGHEST for action security_group_members [ 690.861896] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aceee07e-3675-474c-96e8-9fe510f1356f with Priority: HIGHEST for action security_group_members [ 690.862217] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-aceee07e-3675-474c-96e8-9fe510f1356f taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.862335] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aceee07e-3675-474c-96e8-9fe510f1356f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.862404] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aceee07e-3675-474c-96e8-9fe510f1356f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.862657] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aceee07e-3675-474c-96e8-9fe510f1356f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.862808] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.862904] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.862966] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.864030] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.864170] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.864297] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('aceee07e-3675-474c-96e8-9fe510f1356f',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 690.982674] env[65306]: INFO networking_nsxv3.common.synchronization [req-11063805-9929-48c3-ba08-c62f9ab5dc37 req-405601bd-88ba-4585-8d5a-9667d2700b2a tempest-SecurityGroupRulesTestJSON-350827756 tempest-SecurityGroupRulesTestJSON-350827756-project-member] Enqueued Resource ID: b87ce618-75ac-4ee1-9f82-c65f457565ef with Priority: HIGHEST for action security_group_rules [ 690.982958] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b87ce618-75ac-4ee1-9f82-c65f457565ef with Priority: HIGHEST for action security_group_rules [ 690.983931] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b87ce618-75ac-4ee1-9f82-c65f457565ef taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.983931] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b87ce618-75ac-4ee1-9f82-c65f457565ef" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.983931] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b87ce618-75ac-4ee1-9f82-c65f457565ef" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.984106] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b87ce618-75ac-4ee1-9f82-c65f457565ef" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.984225] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b87ce618-75ac-4ee1-9f82-c65f457565ef',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 691.044897] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f5174f7c-dc12-4dad-9284-eed34d64b830',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 691.225518] env[65306]: INFO networking_nsxv3.common.synchronization [req-668ccc36-ca6e-4605-8301-93343ec0b50d req-2f2b9c5f-7a26-4e28-ab47-cee3d86b8fed tempest-ServersTestMultiNic-959517935 tempest-ServersTestMultiNic-959517935-project-member] Enqueued Resource ID: f5174f7c-dc12-4dad-9284-eed34d64b830 with Priority: HIGHEST for action security_group_members [ 691.226125] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f5174f7c-dc12-4dad-9284-eed34d64b830 with Priority: HIGHEST for action security_group_members [ 691.226832] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-f5174f7c-dc12-4dad-9284-eed34d64b830 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.226832] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f5174f7c-dc12-4dad-9284-eed34d64b830" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.279813] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3d7e63c8-5b54-4e8c-889b-658da24748dc',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 691.354904] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock network-645 taken with stack trace [, , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.354904] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "network-645" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.354904] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "network-645" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.355188] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "network-645" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.355348] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.355519] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.355784] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.356790] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.356790] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.356790] env[65306]: DEBUG dogpile.cache.region [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] No value present for key: 'zone-id' {{(pid=65306) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 691.356790] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] NeedRegenerationException {{(pid=65306) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 691.356790] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] no value, waiting for create lock {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 691.356790] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] value creation lock acquired {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 691.356790] env[65306]: DEBUG dogpile.cache.region [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] No value present for key: 'zone-id' {{(pid=65306) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 691.357204] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Calling creation function for not-yet-present value {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 691.357204] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 691.366108] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.366276] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.366345] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.366584] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.366698] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.366906] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.367022] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.367087] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.367293] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.367406] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.367496] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aceee07e-3675-474c-96e8-9fe510f1356f already deleted. [ 691.367550] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aceee07e-3675-474c-96e8-9fe510f1356f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.379558] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 691.379825] env[65306]: DEBUG dogpile.cache.region [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65306) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 691.379889] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Released creation lock {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 691.380072] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "network-645" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.380428] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock port-38bb0808-9c9b-42d9-98b1-2d332f4bd0e9 taken with stack trace [, , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.380597] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "port-38bb0808-9c9b-42d9-98b1-2d332f4bd0e9" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.380724] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "port-38bb0808-9c9b-42d9-98b1-2d332f4bd0e9" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.381067] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "port-38bb0808-9c9b-42d9-98b1-2d332f4bd0e9" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.381210] env[65306]: DEBUG networking_nsxv3.api.rpc [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('38bb0808-9c9b-42d9-98b1-2d332f4bd0e9',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 691.507360] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.507544] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.507625] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.507933] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.508687] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.508687] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b87ce618-75ac-4ee1-9f82-c65f457565ef already deleted. [ 691.508687] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b87ce618-75ac-4ee1-9f82-c65f457565ef" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.547677] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f5174f7c-dc12-4dad-9284-eed34d64b830',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 691.782742] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.782866] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.783383] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.783383] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.783383] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.783383] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3d7e63c8-5b54-4e8c-889b-658da24748dc is going to be created. [ 691.810986] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.811212] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.811259] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.811472] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.811668] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.824141] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3d7e63c8-5b54-4e8c-889b-658da24748dc in Status: UNINITIALIZED for 2s [ 691.883489] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.883760] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.884021] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.884266] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.884418] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.884574] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Segment Port 38bb0808-9c9b-42d9-98b1-2d332f4bd0e9 not found, creating... [ 691.884834] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.884987] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.885114] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.885337] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.885463] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.885738] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.886416] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.886416] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.886416] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.886416] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.886599] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Resource: SegmentPort with ID: 38bb0808-9c9b-42d9-98b1-2d332f4bd0e9 is going to be created. [ 691.918847] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.918847] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.918847] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.918847] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.918847] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.919103] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "port-38bb0808-9c9b-42d9-98b1-2d332f4bd0e9" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.945815] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: df9d38aa-4663-42d9-8451-f5b81969567d in Status: SUCCESS [ 691.946310] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-df9d38aa-4663-42d9-8451-f5b81969567d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.946310] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-df9d38aa-4663-42d9-8451-f5b81969567d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.946579] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-df9d38aa-4663-42d9-8451-f5b81969567d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.947349] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.947349] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.947349] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.947629] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.947629] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.947718] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('df9d38aa-4663-42d9-8451-f5b81969567d',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 692.051445] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.051445] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.051445] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.051445] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.051445] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.051445] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f5174f7c-dc12-4dad-9284-eed34d64b830 is going to be updated. [ 692.085786] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.085954] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.085954] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.086285] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.086580] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.096633] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f5174f7c-dc12-4dad-9284-eed34d64b830 in Status: IN_PROGRESS for 2s [ 692.450605] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.450755] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.450877] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.451135] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.451234] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.451353] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.451482] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.452108] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.452108] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.452108] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.452108] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: df9d38aa-4663-42d9-8451-f5b81969567d is going to be updated. [ 692.483439] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.483623] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.483767] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.484088] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.484259] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.495227] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: df9d38aa-4663-42d9-8451-f5b81969567d in Status: IN_PROGRESS for 2s [ 692.668933] env[65306]: INFO networking_nsxv3.common.synchronization [req-ccff2744-dc6d-475e-8be7-481a7eeac14b req-3c310b65-7d55-427f-a2e8-da5ae6405621 service nova] Enqueued Resource ID: aceee07e-3675-474c-96e8-9fe510f1356f with Priority: HIGHEST for action security_group_rules [ 692.668933] env[65306]: INFO networking_nsxv3.common.synchronization [req-ccff2744-dc6d-475e-8be7-481a7eeac14b req-3c310b65-7d55-427f-a2e8-da5ae6405621 service nova] Enqueued Resource ID: aceee07e-3675-474c-96e8-9fe510f1356f with Priority: HIGHEST for action security_group_members [ 692.668933] env[65306]: INFO networking_nsxv3.common.synchronization [req-ccff2744-dc6d-475e-8be7-481a7eeac14b req-3c310b65-7d55-427f-a2e8-da5ae6405621 service nova] Enqueued Resource ID: 38bb0808-9c9b-42d9-98b1-2d332f4bd0e9 with Priority: HIGHEST for action port [ 692.669518] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aceee07e-3675-474c-96e8-9fe510f1356f with Priority: HIGHEST for action security_group_rules [ 692.669656] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aceee07e-3675-474c-96e8-9fe510f1356f with Priority: HIGHEST for action security_group_members [ 692.670765] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 38bb0808-9c9b-42d9-98b1-2d332f4bd0e9 with Priority: HIGHEST for action port [ 692.670765] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock rules-aceee07e-3675-474c-96e8-9fe510f1356f taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.670765] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-aceee07e-3675-474c-96e8-9fe510f1356f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.670765] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-aceee07e-3675-474c-96e8-9fe510f1356f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.670765] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-aceee07e-3675-474c-96e8-9fe510f1356f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.670765] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('aceee07e-3675-474c-96e8-9fe510f1356f',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 692.672205] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-aceee07e-3675-474c-96e8-9fe510f1356f taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.672262] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aceee07e-3675-474c-96e8-9fe510f1356f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.672300] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aceee07e-3675-474c-96e8-9fe510f1356f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.673047] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aceee07e-3675-474c-96e8-9fe510f1356f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.673047] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.673047] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.673047] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.673047] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.673047] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.673047] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('aceee07e-3675-474c-96e8-9fe510f1356f',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 692.673810] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock port-38bb0808-9c9b-42d9-98b1-2d332f4bd0e9 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.673947] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-38bb0808-9c9b-42d9-98b1-2d332f4bd0e9" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.674018] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-38bb0808-9c9b-42d9-98b1-2d332f4bd0e9" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.674172] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-38bb0808-9c9b-42d9-98b1-2d332f4bd0e9" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.674246] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('38bb0808-9c9b-42d9-98b1-2d332f4bd0e9',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 692.957863] env[65306]: INFO networking_nsxv3.common.synchronization [req-20ca5310-025b-491d-88d8-6ab74daba029 req-977ae420-88da-4a5a-8364-5c6bafe19387 tempest-ServerDiagnosticsTest-490615988 tempest-ServerDiagnosticsTest-490615988-project-member] Enqueued Resource ID: a05c132c-ec2c-4f0a-90d8-a619996ad7aa with Priority: HIGHEST for action security_group_members [ 692.960842] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a05c132c-ec2c-4f0a-90d8-a619996ad7aa with Priority: HIGHEST for action security_group_members [ 692.961398] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-a05c132c-ec2c-4f0a-90d8-a619996ad7aa taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.961570] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a05c132c-ec2c-4f0a-90d8-a619996ad7aa" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.961738] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a05c132c-ec2c-4f0a-90d8-a619996ad7aa" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.961999] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a05c132c-ec2c-4f0a-90d8-a619996ad7aa" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.962205] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.962432] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.962529] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.962814] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.962933] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.963164] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a05c132c-ec2c-4f0a-90d8-a619996ad7aa',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 693.172911] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-aceee07e-3675-474c-96e8-9fe510f1356f taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.172911] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aceee07e-3675-474c-96e8-9fe510f1356f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.179645] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 38bb0808-9c9b-42d9-98b1-2d332f4bd0e9 with status ACTIVE [ 693.179645] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.179645] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.179645] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.179645] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.179645] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.179645] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.179645] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.179645] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.179645] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.179645] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.179645] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.179645] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.179645] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.179645] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.179645] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.179645] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 38bb0808-9c9b-42d9-98b1-2d332f4bd0e9 is going to be updated. [ 693.181193] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('aceee07e-3675-474c-96e8-9fe510f1356f',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 693.203370] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.205273] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.205703] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.205963] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.206149] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.206314] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-38bb0808-9c9b-42d9-98b1-2d332f4bd0e9" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.466074] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.467047] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.467047] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.467047] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.467047] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.467396] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.467496] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.467559] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.467771] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.467906] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.468068] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a05c132c-ec2c-4f0a-90d8-a619996ad7aa is going to be updated. [ 693.504350] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.504668] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.504730] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.504951] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.505153] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.519685] env[65306]: INFO networking_nsxv3.common.synchronization [req-a627d5eb-1bd8-43c2-b239-70c93ff37f1f req-17da2fda-94b1-427b-bba4-733094a8b676 tempest-SecurityGroupRulesTestJSON-350827756 tempest-SecurityGroupRulesTestJSON-350827756-project-member] Enqueued Resource ID: 70551157-f49c-4a5b-b996-47e02496d94e with Priority: HIGHEST for action security_group_rules [ 693.519941] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 70551157-f49c-4a5b-b996-47e02496d94e with Priority: HIGHEST for action security_group_rules [ 693.521955] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a05c132c-ec2c-4f0a-90d8-a619996ad7aa in Status: IN_PROGRESS for 2s [ 693.521955] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock rules-70551157-f49c-4a5b-b996-47e02496d94e taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.523046] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-70551157-f49c-4a5b-b996-47e02496d94e" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.523046] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-70551157-f49c-4a5b-b996-47e02496d94e" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.523274] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-70551157-f49c-4a5b-b996-47e02496d94e" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.523425] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('70551157-f49c-4a5b-b996-47e02496d94e',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 693.683847] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('aceee07e-3675-474c-96e8-9fe510f1356f',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 693.837353] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3d7e63c8-5b54-4e8c-889b-658da24748dc in Status: SUCCESS [ 693.837483] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3d7e63c8-5b54-4e8c-889b-658da24748dc" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.838108] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3d7e63c8-5b54-4e8c-889b-658da24748dc" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.838108] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3d7e63c8-5b54-4e8c-889b-658da24748dc" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.838108] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.838327] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.838327] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.838460] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.838527] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.838793] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3d7e63c8-5b54-4e8c-889b-658da24748dc" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.838793] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3d7e63c8-5b54-4e8c-889b-658da24748dc',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 694.049926] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.049926] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.049926] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.050100] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.050100] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.050181] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 70551157-f49c-4a5b-b996-47e02496d94e already deleted. [ 694.050290] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-70551157-f49c-4a5b-b996-47e02496d94e" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.109752] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f5174f7c-dc12-4dad-9284-eed34d64b830 in Status: SUCCESS [ 694.109957] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f5174f7c-dc12-4dad-9284-eed34d64b830" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.110144] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f5174f7c-dc12-4dad-9284-eed34d64b830" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.110569] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f5174f7c-dc12-4dad-9284-eed34d64b830" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.110663] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.110756] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.110843] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.111039] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.111182] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.111282] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f5174f7c-dc12-4dad-9284-eed34d64b830',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 694.187067] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.188381] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.188381] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.188381] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.188381] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.188381] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aceee07e-3675-474c-96e8-9fe510f1356f is going to be created. [ 694.215039] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.215436] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.216202] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.216202] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.216202] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.227851] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aceee07e-3675-474c-96e8-9fe510f1356f in Status: UNINITIALIZED for 2s [ 694.344290] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3d7e63c8-5b54-4e8c-889b-658da24748dc',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 694.507562] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: df9d38aa-4663-42d9-8451-f5b81969567d in Status: SUCCESS [ 694.507857] env[65306]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: df9d38aa-4663-42d9-8451-f5b81969567d deletion is rescheduled due to dependency. [ 694.507964] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-df9d38aa-4663-42d9-8451-f5b81969567d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.614338] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.614338] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.614338] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.615234] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.615658] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.618038] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.618038] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.618038] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.618038] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.618038] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.618038] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f5174f7c-dc12-4dad-9284-eed34d64b830 is going to be updated. [ 694.666160] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.666310] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.666380] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.666613] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.666820] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.679832] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f5174f7c-dc12-4dad-9284-eed34d64b830 in Status: IN_PROGRESS for 2s [ 694.846544] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3d7e63c8-5b54-4e8c-889b-658da24748dc: rpc.has_security_group_logging(os_id): False [ 694.867731] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.867731] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.867985] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.867985] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.868146] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.868784] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.868784] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.868784] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.868784] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.868784] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.869285] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3d7e63c8-5b54-4e8c-889b-658da24748dc is going to be created. [ 694.956619] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.956619] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.956619] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.956619] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.957114] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.975543] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3d7e63c8-5b54-4e8c-889b-658da24748dc in Status: IN_PROGRESS for 2s [ 695.532202] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a05c132c-ec2c-4f0a-90d8-a619996ad7aa in Status: SUCCESS [ 695.532474] env[65306]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a05c132c-ec2c-4f0a-90d8-a619996ad7aa deletion is rescheduled due to dependency. [ 695.532763] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a05c132c-ec2c-4f0a-90d8-a619996ad7aa" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.744724] env[65306]: INFO networking_nsxv3.common.synchronization [req-b2a11120-0121-463d-847f-45d844242e2e req-021a6be7-0218-4419-ad3c-fcfa5ee31b2c tempest-ServersWithSpecificFlavorTestJSON-1706838422 tempest-ServersWithSpecificFlavorTestJSON-1706838422-project-member] Enqueued Resource ID: ef5de9e7-0c3b-4386-af3c-de134eff75f3 with Priority: HIGHEST for action security_group_members [ 695.745918] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ef5de9e7-0c3b-4386-af3c-de134eff75f3 with Priority: HIGHEST for action security_group_members [ 695.746390] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-ef5de9e7-0c3b-4386-af3c-de134eff75f3 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.746533] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ef5de9e7-0c3b-4386-af3c-de134eff75f3" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.746684] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ef5de9e7-0c3b-4386-af3c-de134eff75f3" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.746961] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ef5de9e7-0c3b-4386-af3c-de134eff75f3" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.747275] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.747437] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.747437] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.747717] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.747878] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.748032] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ef5de9e7-0c3b-4386-af3c-de134eff75f3',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 696.238025] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aceee07e-3675-474c-96e8-9fe510f1356f in Status: SUCCESS [ 696.238330] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aceee07e-3675-474c-96e8-9fe510f1356f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.238458] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aceee07e-3675-474c-96e8-9fe510f1356f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.238661] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aceee07e-3675-474c-96e8-9fe510f1356f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.238855] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.238973] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.239068] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.239209] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.240345] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.240345] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aceee07e-3675-474c-96e8-9fe510f1356f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.240345] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('aceee07e-3675-474c-96e8-9fe510f1356f',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 696.254514] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.254747] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.256094] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.257033] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.257033] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.257033] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.257033] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.257033] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.257330] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.257330] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.257403] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ef5de9e7-0c3b-4386-af3c-de134eff75f3 is going to be updated. [ 696.292566] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.293019] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.293019] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.293179] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.293265] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.305982] env[65306]: INFO networking_nsxv3.common.synchronization [req-9c6ee583-2c0f-4952-a733-cf7d48d2f9a7 req-ac6c8853-fe2f-4234-b762-5e330f8cba58 tempest-FloatingIPsAssociationTestJSON-1677333687 tempest-FloatingIPsAssociationTestJSON-1677333687-project-member] Enqueued Resource ID: 3eee5457-701b-405e-bdf2-f055e0150d49 with Priority: HIGHEST for action security_group_members [ 696.306961] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ef5de9e7-0c3b-4386-af3c-de134eff75f3 in Status: IN_PROGRESS for 2s [ 696.307772] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3eee5457-701b-405e-bdf2-f055e0150d49 with Priority: HIGHEST for action security_group_members [ 696.308131] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-3eee5457-701b-405e-bdf2-f055e0150d49 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.308275] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3eee5457-701b-405e-bdf2-f055e0150d49" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.308325] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3eee5457-701b-405e-bdf2-f055e0150d49" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.308588] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3eee5457-701b-405e-bdf2-f055e0150d49" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.308745] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.308863] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.308927] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.309118] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.309203] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.309292] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3eee5457-701b-405e-bdf2-f055e0150d49',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 696.692876] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f5174f7c-dc12-4dad-9284-eed34d64b830 in Status: SUCCESS [ 696.693077] env[65306]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f5174f7c-dc12-4dad-9284-eed34d64b830 deletion is rescheduled due to dependency. [ 696.693689] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f5174f7c-dc12-4dad-9284-eed34d64b830" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.693689] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f5174f7c-dc12-4dad-9284-eed34d64b830" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.693689] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f5174f7c-dc12-4dad-9284-eed34d64b830" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.693928] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.693928] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.694053] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.694123] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.694206] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.694301] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f5174f7c-dc12-4dad-9284-eed34d64b830',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 696.744864] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-aceee07e-3675-474c-96e8-9fe510f1356f taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.745043] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aceee07e-3675-474c-96e8-9fe510f1356f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.746119] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aceee07e-3675-474c-96e8-9fe510f1356f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.746119] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aceee07e-3675-474c-96e8-9fe510f1356f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.746119] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.746119] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.746119] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.746119] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.747154] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.747154] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aceee07e-3675-474c-96e8-9fe510f1356f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.747782] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-aceee07e-3675-474c-96e8-9fe510f1356f taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.747782] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aceee07e-3675-474c-96e8-9fe510f1356f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.747782] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aceee07e-3675-474c-96e8-9fe510f1356f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.747782] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aceee07e-3675-474c-96e8-9fe510f1356f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.747782] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.748019] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.748019] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.748217] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.748298] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.749088] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aceee07e-3675-474c-96e8-9fe510f1356f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.749088] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('aceee07e-3675-474c-96e8-9fe510f1356f',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 696.812207] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock network-111 taken with stack trace [, , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.812351] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "network-111" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.812509] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "network-111" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.812790] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "network-111" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.813863] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.814592] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.814854] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.815177] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.815350] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.815578] env[65306]: DEBUG dogpile.cache.region [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] No value present for key: 'zone-id' {{(pid=65306) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 696.815685] env[65306]: DEBUG dogpile.lock [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] NeedRegenerationException {{(pid=65306) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 696.815803] env[65306]: DEBUG dogpile.lock [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] no value, waiting for create lock {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 696.815981] env[65306]: DEBUG dogpile.lock [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] value creation lock acquired {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 696.816077] env[65306]: DEBUG dogpile.cache.region [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] No value present for key: 'zone-id' {{(pid=65306) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 696.816181] env[65306]: DEBUG dogpile.lock [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Calling creation function for not-yet-present value {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 696.816310] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 696.818212] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.818333] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.818584] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.818786] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.819211] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.819630] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.819873] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.820117] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.820308] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.821294] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.821402] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3eee5457-701b-405e-bdf2-f055e0150d49 already deleted. [ 696.821500] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3eee5457-701b-405e-bdf2-f055e0150d49" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.843228] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 696.843381] env[65306]: DEBUG dogpile.cache.region [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=65306) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 696.843511] env[65306]: DEBUG dogpile.lock [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Released creation lock {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 696.844998] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "network-111" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.844998] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock port-41e7179d-86e1-4d90-8777-0dcc2b3d331c taken with stack trace [, , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.844998] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "port-41e7179d-86e1-4d90-8777-0dcc2b3d331c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.844998] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "port-41e7179d-86e1-4d90-8777-0dcc2b3d331c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.844998] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "port-41e7179d-86e1-4d90-8777-0dcc2b3d331c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.844998] env[65306]: DEBUG networking_nsxv3.api.rpc [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('41e7179d-86e1-4d90-8777-0dcc2b3d331c',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 696.993725] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3d7e63c8-5b54-4e8c-889b-658da24748dc in Status: SUCCESS [ 696.994578] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3d7e63c8-5b54-4e8c-889b-658da24748dc" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.198048] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.198459] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.198563] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.198833] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.198944] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.199194] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.199363] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.199445] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.199604] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.199694] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.199796] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f5174f7c-dc12-4dad-9284-eed34d64b830 is going to be updated. [ 697.229969] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.230095] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.230095] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.230732] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.230732] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.243166] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f5174f7c-dc12-4dad-9284-eed34d64b830 in Status: IN_PROGRESS for 2s [ 697.252582] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for aceee07e-3675-474c-96e8-9fe510f1356f: rpc.has_security_group_logging(os_id): False [ 697.279830] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.279830] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.279830] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.279830] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.279830] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.279830] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.279830] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.279830] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.279830] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.279830] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.279830] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.279830] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.279830] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.279830] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.279830] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.280543] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.280654] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.280724] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.280922] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.281021] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.281410] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: aceee07e-3675-474c-96e8-9fe510f1356f is going to be created. [ 697.348344] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.349070] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.349244] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.349772] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.349772] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.350283] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Segment Port 41e7179d-86e1-4d90-8777-0dcc2b3d331c not found, creating... [ 697.350583] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.350583] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.353371] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.355530] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.356782] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.357715] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.357999] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.358173] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.358457] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.358590] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.358804] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Resource: SegmentPort with ID: 41e7179d-86e1-4d90-8777-0dcc2b3d331c is going to be created. [ 697.386596] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.386822] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.386822] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.387068] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.387265] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.393749] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.393977] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.393977] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.394308] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.394596] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.394796] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "port-41e7179d-86e1-4d90-8777-0dcc2b3d331c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.403246] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: aceee07e-3675-474c-96e8-9fe510f1356f in Status: IN_PROGRESS for 2s [ 698.123509] env[65306]: INFO networking_nsxv3.common.synchronization [req-da0f5ad5-3636-404d-8ce6-6086d0a1714d req-8924156b-12ac-469e-a993-470cb5316692 tempest-SecurityGroupRulesTestJSON-350827756 tempest-SecurityGroupRulesTestJSON-350827756-project-member] Enqueued Resource ID: 79b02e70-ee26-4227-8483-ee14269b290f with Priority: HIGHEST for action security_group_rules [ 698.124346] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 79b02e70-ee26-4227-8483-ee14269b290f with Priority: HIGHEST for action security_group_rules [ 698.124346] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock rules-79b02e70-ee26-4227-8483-ee14269b290f taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.124437] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-79b02e70-ee26-4227-8483-ee14269b290f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.124522] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-79b02e70-ee26-4227-8483-ee14269b290f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.124779] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-79b02e70-ee26-4227-8483-ee14269b290f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.124856] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('79b02e70-ee26-4227-8483-ee14269b290f',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 698.141521] env[65306]: INFO networking_nsxv3.common.synchronization [req-9c6ee583-2c0f-4952-a733-cf7d48d2f9a7 req-f5075cd4-ca38-43c3-8964-bd52c3242905 service nova] Enqueued Resource ID: 3eee5457-701b-405e-bdf2-f055e0150d49 with Priority: HIGHEST for action security_group_rules [ 698.141782] env[65306]: INFO networking_nsxv3.common.synchronization [req-9c6ee583-2c0f-4952-a733-cf7d48d2f9a7 req-f5075cd4-ca38-43c3-8964-bd52c3242905 service nova] Enqueued Resource ID: 3eee5457-701b-405e-bdf2-f055e0150d49 with Priority: HIGHEST for action security_group_members [ 698.141941] env[65306]: INFO networking_nsxv3.common.synchronization [req-9c6ee583-2c0f-4952-a733-cf7d48d2f9a7 req-f5075cd4-ca38-43c3-8964-bd52c3242905 service nova] Enqueued Resource ID: 41e7179d-86e1-4d90-8777-0dcc2b3d331c with Priority: HIGHEST for action port [ 698.142465] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3eee5457-701b-405e-bdf2-f055e0150d49 with Priority: HIGHEST for action security_group_rules [ 698.142643] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3eee5457-701b-405e-bdf2-f055e0150d49 with Priority: HIGHEST for action security_group_members [ 698.142757] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 41e7179d-86e1-4d90-8777-0dcc2b3d331c with Priority: HIGHEST for action port [ 698.143036] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3eee5457-701b-405e-bdf2-f055e0150d49 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.143158] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3eee5457-701b-405e-bdf2-f055e0150d49" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.143222] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3eee5457-701b-405e-bdf2-f055e0150d49" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.143468] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3eee5457-701b-405e-bdf2-f055e0150d49" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.143545] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3eee5457-701b-405e-bdf2-f055e0150d49',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 698.144366] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-3eee5457-701b-405e-bdf2-f055e0150d49 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.144474] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3eee5457-701b-405e-bdf2-f055e0150d49" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.144538] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3eee5457-701b-405e-bdf2-f055e0150d49" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.144709] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3eee5457-701b-405e-bdf2-f055e0150d49" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.144850] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.144936] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.144996] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.145141] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.145218] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.145309] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3eee5457-701b-405e-bdf2-f055e0150d49',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 698.146293] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock port-41e7179d-86e1-4d90-8777-0dcc2b3d331c taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.146391] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-41e7179d-86e1-4d90-8777-0dcc2b3d331c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.146456] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-41e7179d-86e1-4d90-8777-0dcc2b3d331c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.148209] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-41e7179d-86e1-4d90-8777-0dcc2b3d331c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.148209] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('41e7179d-86e1-4d90-8777-0dcc2b3d331c',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 698.323806] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ef5de9e7-0c3b-4386-af3c-de134eff75f3 in Status: SUCCESS [ 698.323806] env[65306]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ef5de9e7-0c3b-4386-af3c-de134eff75f3 deletion is rescheduled due to dependency. [ 698.323806] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ef5de9e7-0c3b-4386-af3c-de134eff75f3" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.652993] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.653216] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.653216] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.653425] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.653509] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.653600] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 79b02e70-ee26-4227-8483-ee14269b290f already deleted. [ 698.653679] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-79b02e70-ee26-4227-8483-ee14269b290f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.653897] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3eee5457-701b-405e-bdf2-f055e0150d49',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 698.654902] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-3eee5457-701b-405e-bdf2-f055e0150d49 taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.655021] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3eee5457-701b-405e-bdf2-f055e0150d49" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.655321] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 41e7179d-86e1-4d90-8777-0dcc2b3d331c with status ACTIVE [ 698.655506] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.655645] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.655734] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.655928] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.656044] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.656231] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.656363] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.656428] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.656601] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.656703] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.656905] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.657133] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.657260] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.657446] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.657571] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.657686] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 41e7179d-86e1-4d90-8777-0dcc2b3d331c is going to be updated. [ 698.691434] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.691434] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.691434] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.691434] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.691434] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.691434] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-41e7179d-86e1-4d90-8777-0dcc2b3d331c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.160048] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3eee5457-701b-405e-bdf2-f055e0150d49',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 699.258138] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f5174f7c-dc12-4dad-9284-eed34d64b830 in Status: IN_PROGRESS for 4s [ 699.422228] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: aceee07e-3675-474c-96e8-9fe510f1356f in Status: SUCCESS [ 699.422701] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-aceee07e-3675-474c-96e8-9fe510f1356f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.662825] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.662825] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.662825] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.663108] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.663108] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.663189] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3eee5457-701b-405e-bdf2-f055e0150d49 is going to be created. [ 699.692245] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.692245] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.692245] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.692497] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.692497] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.713654] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3eee5457-701b-405e-bdf2-f055e0150d49 in Status: UNINITIALIZED for 2s [ 700.144079] env[65306]: INFO networking_nsxv3.common.synchronization [None req-455a7d7d-7593-495e-bce1-1a5edd7fc731 None None] Enqueued Resource ID: 8409fdcf-cb5c-4403-8afb-1adf6f9e6a11 with Priority: HIGHEST for action port [ 700.144347] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8409fdcf-cb5c-4403-8afb-1adf6f9e6a11 with Priority: HIGHEST for action port [ 700.144907] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock port-8409fdcf-cb5c-4403-8afb-1adf6f9e6a11 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.145038] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8409fdcf-cb5c-4403-8afb-1adf6f9e6a11" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.145109] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8409fdcf-cb5c-4403-8afb-1adf6f9e6a11" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.145502] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8409fdcf-cb5c-4403-8afb-1adf6f9e6a11" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.145609] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8409fdcf-cb5c-4403-8afb-1adf6f9e6a11',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 700.652179] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8409fdcf-cb5c-4403-8afb-1adf6f9e6a11 [ 700.652179] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.652179] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.652179] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.652179] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.652179] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.652179] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8409fdcf-cb5c-4403-8afb-1adf6f9e6a11 already deleted. [ 700.652179] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8409fdcf-cb5c-4403-8afb-1adf6f9e6a11" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.838593] env[65306]: INFO networking_nsxv3.common.synchronization [req-b465be10-6f81-42de-844e-f976adac09b6 req-1b535750-435e-4b12-85b4-9ea10c52efad tempest-ListServersNegativeTestJSON-1230971190 tempest-ListServersNegativeTestJSON-1230971190-project-member] Enqueued Resource ID: 6951f012-9730-40bd-a7af-9b70cd598b05 with Priority: HIGHEST for action security_group_members [ 700.840777] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6951f012-9730-40bd-a7af-9b70cd598b05 with Priority: HIGHEST for action security_group_members [ 700.840777] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-6951f012-9730-40bd-a7af-9b70cd598b05 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.840777] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6951f012-9730-40bd-a7af-9b70cd598b05" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.840777] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6951f012-9730-40bd-a7af-9b70cd598b05" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.840777] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6951f012-9730-40bd-a7af-9b70cd598b05" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.840777] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.841071] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.841071] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.841214] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.841318] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.841435] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6951f012-9730-40bd-a7af-9b70cd598b05',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 701.270245] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f5174f7c-dc12-4dad-9284-eed34d64b830 in Status: SUCCESS [ 701.270528] env[65306]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f5174f7c-dc12-4dad-9284-eed34d64b830 deletion is rescheduled due to dependency. [ 701.270650] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f5174f7c-dc12-4dad-9284-eed34d64b830" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.346812] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6951f012-9730-40bd-a7af-9b70cd598b05',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 701.725031] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3eee5457-701b-405e-bdf2-f055e0150d49 in Status: SUCCESS [ 701.725271] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3eee5457-701b-405e-bdf2-f055e0150d49" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.727947] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3eee5457-701b-405e-bdf2-f055e0150d49" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.727947] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3eee5457-701b-405e-bdf2-f055e0150d49" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.727947] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.727947] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.727947] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.727947] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.727947] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.727947] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3eee5457-701b-405e-bdf2-f055e0150d49" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.727947] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3eee5457-701b-405e-bdf2-f055e0150d49',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 701.853709] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6951f012-9730-40bd-a7af-9b70cd598b05',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 702.231998] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-3eee5457-701b-405e-bdf2-f055e0150d49 taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.231998] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3eee5457-701b-405e-bdf2-f055e0150d49" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.232140] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3eee5457-701b-405e-bdf2-f055e0150d49" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.232282] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3eee5457-701b-405e-bdf2-f055e0150d49" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.232444] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.232539] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.232600] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.232806] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.232806] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.233094] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3eee5457-701b-405e-bdf2-f055e0150d49" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.233094] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-3eee5457-701b-405e-bdf2-f055e0150d49 taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.233373] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3eee5457-701b-405e-bdf2-f055e0150d49" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.233373] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3eee5457-701b-405e-bdf2-f055e0150d49" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.233373] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3eee5457-701b-405e-bdf2-f055e0150d49" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.233559] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.233719] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.233719] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.233885] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.233950] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.234019] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3eee5457-701b-405e-bdf2-f055e0150d49" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.234126] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3eee5457-701b-405e-bdf2-f055e0150d49',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 702.279751] env[65306]: INFO networking_nsxv3.common.synchronization [req-eaf1a19e-efbb-4f13-b571-3607b5576a0f req-aae338e2-820a-431e-9fb2-47b8952bed85 tempest-ListServersNegativeTestJSON-1230971190 tempest-ListServersNegativeTestJSON-1230971190-project-member] Enqueued Resource ID: 6951f012-9730-40bd-a7af-9b70cd598b05 with Priority: HIGHEST for action security_group_members [ 702.280719] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6951f012-9730-40bd-a7af-9b70cd598b05 with Priority: HIGHEST for action security_group_members [ 702.280957] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-6951f012-9730-40bd-a7af-9b70cd598b05 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.281078] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6951f012-9730-40bd-a7af-9b70cd598b05" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.334439] env[65306]: INFO networking_nsxv3.common.synchronization [None req-3f01dcaf-4b2a-4bee-9215-5e0416cd23cd None None] Enqueued Resource ID: 7864ffae-94c7-461e-87f9-b7c2080d1912 with Priority: HIGHEST for action port [ 702.335434] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7864ffae-94c7-461e-87f9-b7c2080d1912 with Priority: HIGHEST for action port [ 702.335434] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock port-7864ffae-94c7-461e-87f9-b7c2080d1912 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.335434] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7864ffae-94c7-461e-87f9-b7c2080d1912" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.335434] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7864ffae-94c7-461e-87f9-b7c2080d1912" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.335690] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7864ffae-94c7-461e-87f9-b7c2080d1912" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.335724] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7864ffae-94c7-461e-87f9-b7c2080d1912',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 702.356883] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.359973] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.359973] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.359973] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.359973] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.359973] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6951f012-9730-40bd-a7af-9b70cd598b05 is going to be updated. [ 702.389682] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.390069] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.390294] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.390635] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.391882] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.400873] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6951f012-9730-40bd-a7af-9b70cd598b05 in Status: IN_PROGRESS for 2s [ 702.739058] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3eee5457-701b-405e-bdf2-f055e0150d49: rpc.has_security_group_logging(os_id): False [ 702.758846] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.759033] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.759114] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.759356] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.759485] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.759727] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.759832] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.759899] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.760099] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.760188] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.760371] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.760470] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.760534] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.760699] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.760970] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.760970] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.761202] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.761298] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.761480] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.761594] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.761720] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3eee5457-701b-405e-bdf2-f055e0150d49 is going to be created. [ 702.831225] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.831373] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.831427] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.831655] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.831857] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.839523] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7864ffae-94c7-461e-87f9-b7c2080d1912 [ 702.839523] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.839523] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.839523] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.839523] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.839523] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.839523] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7864ffae-94c7-461e-87f9-b7c2080d1912 already deleted. [ 702.839813] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7864ffae-94c7-461e-87f9-b7c2080d1912" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.845414] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3eee5457-701b-405e-bdf2-f055e0150d49 in Status: IN_PROGRESS for 2s [ 704.384625] env[65306]: INFO networking_nsxv3.common.synchronization [req-11a59f7d-d075-4964-9efa-3e7423a4c905 req-afb24051-b7f5-4623-92ab-d1040f2efc11 tempest-ListImageFiltersTestJSON-1021467922 tempest-ListImageFiltersTestJSON-1021467922-project-member] Enqueued Resource ID: 0defdd0d-cdbe-4a7c-9871-fd4c40a3847e with Priority: HIGHEST for action security_group_members [ 704.385220] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0defdd0d-cdbe-4a7c-9871-fd4c40a3847e with Priority: HIGHEST for action security_group_members [ 704.385718] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-0defdd0d-cdbe-4a7c-9871-fd4c40a3847e taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.385718] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0defdd0d-cdbe-4a7c-9871-fd4c40a3847e" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.385718] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0defdd0d-cdbe-4a7c-9871-fd4c40a3847e" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.385974] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0defdd0d-cdbe-4a7c-9871-fd4c40a3847e" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.386462] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.386462] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.386462] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.386462] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.386677] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.386677] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0defdd0d-cdbe-4a7c-9871-fd4c40a3847e',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 704.413394] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6951f012-9730-40bd-a7af-9b70cd598b05 in Status: SUCCESS [ 704.413687] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6951f012-9730-40bd-a7af-9b70cd598b05" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.414181] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6951f012-9730-40bd-a7af-9b70cd598b05" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.414405] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6951f012-9730-40bd-a7af-9b70cd598b05" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.414595] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.414940] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.414940] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.414940] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.415131] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.415131] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6951f012-9730-40bd-a7af-9b70cd598b05',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 704.618754] env[65306]: INFO networking_nsxv3.common.synchronization [None req-24c9c5ee-f9ac-44e8-bd56-bf6cf9d77be2 None None] Enqueued Resource ID: 456eef5c-7c35-4cb7-87b5-3b548a288e8c with Priority: HIGHEST for action port [ 704.619542] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 456eef5c-7c35-4cb7-87b5-3b548a288e8c with Priority: HIGHEST for action port [ 704.620133] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock port-456eef5c-7c35-4cb7-87b5-3b548a288e8c taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.621426] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-456eef5c-7c35-4cb7-87b5-3b548a288e8c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.621562] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-456eef5c-7c35-4cb7-87b5-3b548a288e8c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.623406] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-456eef5c-7c35-4cb7-87b5-3b548a288e8c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.623406] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('456eef5c-7c35-4cb7-87b5-3b548a288e8c',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 704.814475] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock network-707 taken with stack trace [, , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.814761] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "network-707" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.814958] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "network-707" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.818161] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "network-707" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.818619] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.818893] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.819104] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.819473] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.819706] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.820616] env[65306]: DEBUG dogpile.cache.region [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] No value present for key: 'zone-id' {{(pid=65306) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 704.820813] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] NeedRegenerationException {{(pid=65306) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 704.821013] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] no value, waiting for create lock {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 704.821228] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] value creation lock acquired {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 704.821425] env[65306]: DEBUG dogpile.cache.region [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] No value present for key: 'zone-id' {{(pid=65306) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 704.821611] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Calling creation function for not-yet-present value {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 704.827042] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 704.854868] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 704.855049] env[65306]: DEBUG dogpile.cache.region [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Cache value generated in 0.033 seconds for key(s): 'zone-id' {{(pid=65306) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 704.855196] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Released creation lock {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 704.855840] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "network-707" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.855840] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock port-837e985b-d93c-473e-81f7-86648ea7676e taken with stack trace [, , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.855990] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "port-837e985b-d93c-473e-81f7-86648ea7676e" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.856055] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "port-837e985b-d93c-473e-81f7-86648ea7676e" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.856336] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "port-837e985b-d93c-473e-81f7-86648ea7676e" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.856472] env[65306]: DEBUG networking_nsxv3.api.rpc [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('837e985b-d93c-473e-81f7-86648ea7676e',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 704.862745] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3eee5457-701b-405e-bdf2-f055e0150d49 in Status: SUCCESS [ 704.862987] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3eee5457-701b-405e-bdf2-f055e0150d49" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.888623] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.889182] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.889182] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.889182] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.889182] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.889716] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.889716] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.889716] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.889716] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.889856] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.889856] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0defdd0d-cdbe-4a7c-9871-fd4c40a3847e already deleted. [ 704.889942] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0defdd0d-cdbe-4a7c-9871-fd4c40a3847e" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.918315] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.918980] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.919153] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.919531] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.919689] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.919944] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.920104] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.920199] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.920464] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.920813] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.920813] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6951f012-9730-40bd-a7af-9b70cd598b05 is going to be updated. [ 704.954683] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.955325] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.955475] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.955621] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.955769] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.969337] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6951f012-9730-40bd-a7af-9b70cd598b05 in Status: IN_PROGRESS for 2s [ 705.127023] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 456eef5c-7c35-4cb7-87b5-3b548a288e8c [ 705.127023] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.127023] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.127023] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.127023] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.127023] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.127023] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:456eef5c-7c35-4cb7-87b5-3b548a288e8c already deleted. [ 705.127023] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-456eef5c-7c35-4cb7-87b5-3b548a288e8c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.220268] env[65306]: INFO networking_nsxv3.common.synchronization [req-439cec61-7013-4702-9dae-7e9deb0c37bb req-a65e6bda-01db-4670-a9dc-0bba9e3de32c tempest-VolumesAssistedSnapshotsTest-47459573 tempest-VolumesAssistedSnapshotsTest-47459573-project-member] Enqueued Resource ID: 5ec09b70-aa5a-48ff-b72f-a5c6c81190e0 with Priority: HIGHEST for action security_group_members [ 705.220846] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5ec09b70-aa5a-48ff-b72f-a5c6c81190e0 with Priority: HIGHEST for action security_group_members [ 705.221191] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-5ec09b70-aa5a-48ff-b72f-a5c6c81190e0 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.221277] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5ec09b70-aa5a-48ff-b72f-a5c6c81190e0" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.221340] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5ec09b70-aa5a-48ff-b72f-a5c6c81190e0" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.221537] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5ec09b70-aa5a-48ff-b72f-a5c6c81190e0" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.221684] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.221781] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.221848] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.221998] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.222277] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.222409] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5ec09b70-aa5a-48ff-b72f-a5c6c81190e0',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.360706] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.361137] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.361376] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.362201] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.362201] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.362286] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Segment Port 837e985b-d93c-473e-81f7-86648ea7676e not found, creating... [ 705.362643] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.363025] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.363142] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.364207] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.364207] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.364207] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.364395] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.364566] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.364936] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.365171] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.365381] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Resource: SegmentPort with ID: 837e985b-d93c-473e-81f7-86648ea7676e is going to be created. [ 705.392264] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.392592] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.392830] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.393204] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.393523] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.393853] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "port-837e985b-d93c-473e-81f7-86648ea7676e" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.727417] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.727626] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.727702] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.727915] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.728015] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.728222] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.728322] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.728383] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.728553] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.728643] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.728731] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5ec09b70-aa5a-48ff-b72f-a5c6c81190e0 is going to be updated. [ 705.773010] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.773178] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.773253] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.773517] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.773685] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.784145] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5ec09b70-aa5a-48ff-b72f-a5c6c81190e0 in Status: IN_PROGRESS for 2s [ 705.873214] env[65306]: INFO networking_nsxv3.common.synchronization [req-3621ee40-6bf5-4229-918b-883102a14c02 req-91a5ad4b-e176-4f54-98cd-e7a48726396e tempest-ServerMetadataNegativeTestJSON-1997240022 tempest-ServerMetadataNegativeTestJSON-1997240022-project-member] Enqueued Resource ID: 55a6ae08-0730-4d04-bc2c-3f0c36758315 with Priority: HIGHEST for action security_group_members [ 705.873884] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 55a6ae08-0730-4d04-bc2c-3f0c36758315 with Priority: HIGHEST for action security_group_members [ 705.874529] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-55a6ae08-0730-4d04-bc2c-3f0c36758315 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.874814] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-55a6ae08-0730-4d04-bc2c-3f0c36758315" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.874814] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-55a6ae08-0730-4d04-bc2c-3f0c36758315" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.878185] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-55a6ae08-0730-4d04-bc2c-3f0c36758315" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.878185] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.878185] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.878185] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.878185] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.878185] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.878185] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('55a6ae08-0730-4d04-bc2c-3f0c36758315',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 706.189363] env[65306]: INFO networking_nsxv3.common.synchronization [req-11a59f7d-d075-4964-9efa-3e7423a4c905 req-ed8906b6-f6a5-4c55-9cfb-80f7902993a2 service nova] Enqueued Resource ID: 0defdd0d-cdbe-4a7c-9871-fd4c40a3847e with Priority: HIGHEST for action security_group_rules [ 706.189561] env[65306]: INFO networking_nsxv3.common.synchronization [req-11a59f7d-d075-4964-9efa-3e7423a4c905 req-ed8906b6-f6a5-4c55-9cfb-80f7902993a2 service nova] Enqueued Resource ID: 0defdd0d-cdbe-4a7c-9871-fd4c40a3847e with Priority: HIGHEST for action security_group_members [ 706.189705] env[65306]: INFO networking_nsxv3.common.synchronization [req-11a59f7d-d075-4964-9efa-3e7423a4c905 req-ed8906b6-f6a5-4c55-9cfb-80f7902993a2 service nova] Enqueued Resource ID: 837e985b-d93c-473e-81f7-86648ea7676e with Priority: HIGHEST for action port [ 706.189947] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0defdd0d-cdbe-4a7c-9871-fd4c40a3847e with Priority: HIGHEST for action security_group_rules [ 706.190089] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0defdd0d-cdbe-4a7c-9871-fd4c40a3847e with Priority: HIGHEST for action security_group_members [ 706.190187] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 837e985b-d93c-473e-81f7-86648ea7676e with Priority: HIGHEST for action port [ 706.190749] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0defdd0d-cdbe-4a7c-9871-fd4c40a3847e taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.190872] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0defdd0d-cdbe-4a7c-9871-fd4c40a3847e" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.190940] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0defdd0d-cdbe-4a7c-9871-fd4c40a3847e" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.191349] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0defdd0d-cdbe-4a7c-9871-fd4c40a3847e" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.191449] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0defdd0d-cdbe-4a7c-9871-fd4c40a3847e',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 706.192317] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-0defdd0d-cdbe-4a7c-9871-fd4c40a3847e taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.192400] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0defdd0d-cdbe-4a7c-9871-fd4c40a3847e" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.192506] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0defdd0d-cdbe-4a7c-9871-fd4c40a3847e" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.192761] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0defdd0d-cdbe-4a7c-9871-fd4c40a3847e" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.192890] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.193036] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.193036] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.193145] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.193236] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.193323] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0defdd0d-cdbe-4a7c-9871-fd4c40a3847e',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 706.194524] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock port-837e985b-d93c-473e-81f7-86648ea7676e taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.194524] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-837e985b-d93c-473e-81f7-86648ea7676e" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.194524] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-837e985b-d93c-473e-81f7-86648ea7676e" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.194665] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-837e985b-d93c-473e-81f7-86648ea7676e" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.194719] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('837e985b-d93c-473e-81f7-86648ea7676e',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 706.379994] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.380169] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.380251] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.380828] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.381512] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.381512] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.381512] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.381512] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.381512] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.381701] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.381701] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 55a6ae08-0730-4d04-bc2c-3f0c36758315 is going to be updated. [ 706.411433] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.411433] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.411776] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.411776] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.413053] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.421737] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 55a6ae08-0730-4d04-bc2c-3f0c36758315 in Status: IN_PROGRESS for 2s [ 706.504238] env[65306]: INFO networking_nsxv3.common.synchronization [req-6947f1f8-6826-4a28-b6cc-79cad0a2382c req-08364485-1b31-4653-946c-f1f3bcf9736e tempest-SecurityGroupRulesTestJSON-350827756 tempest-SecurityGroupRulesTestJSON-350827756-project-member] Enqueued Resource ID: 7e20e218-e28d-40e6-a0ff-450ebaa5124b with Priority: HIGHEST for action security_group_rules [ 706.504748] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7e20e218-e28d-40e6-a0ff-450ebaa5124b with Priority: HIGHEST for action security_group_rules [ 706.505053] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7e20e218-e28d-40e6-a0ff-450ebaa5124b taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.505175] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7e20e218-e28d-40e6-a0ff-450ebaa5124b" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.505396] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7e20e218-e28d-40e6-a0ff-450ebaa5124b" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.506033] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7e20e218-e28d-40e6-a0ff-450ebaa5124b" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.506127] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7e20e218-e28d-40e6-a0ff-450ebaa5124b',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 706.696413] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0defdd0d-cdbe-4a7c-9871-fd4c40a3847e',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 706.697107] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-0defdd0d-cdbe-4a7c-9871-fd4c40a3847e taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.697218] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0defdd0d-cdbe-4a7c-9871-fd4c40a3847e" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.700831] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 837e985b-d93c-473e-81f7-86648ea7676e with status ACTIVE [ 706.700965] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.701106] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.701211] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.701373] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.701474] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.704573] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.704705] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.704776] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.704964] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.705361] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.705581] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.705699] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.705778] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.705931] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.706072] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.706115] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 837e985b-d93c-473e-81f7-86648ea7676e is going to be updated. [ 706.729293] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.730103] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.730319] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.730647] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.731132] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.731379] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-837e985b-d93c-473e-81f7-86648ea7676e" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.895176] env[65306]: INFO networking_nsxv3.common.synchronization [None req-8aa83d2e-66e5-4c3b-8b5e-ec5f3f396486 None None] Enqueued Resource ID: 5b30762c-ff29-4860-8c28-b0bdc8b21ef8 with Priority: HIGHEST for action port [ 706.895746] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5b30762c-ff29-4860-8c28-b0bdc8b21ef8 with Priority: HIGHEST for action port [ 706.896061] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock port-5b30762c-ff29-4860-8c28-b0bdc8b21ef8 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.896184] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5b30762c-ff29-4860-8c28-b0bdc8b21ef8" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.896329] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5b30762c-ff29-4860-8c28-b0bdc8b21ef8" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.897036] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5b30762c-ff29-4860-8c28-b0bdc8b21ef8" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.897036] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5b30762c-ff29-4860-8c28-b0bdc8b21ef8',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 706.898985] env[65306]: INFO networking_nsxv3.common.synchronization [req-e2bced4a-7f8e-450a-8c02-bae8094290ed req-04401a49-67f4-4e75-82ac-88f842fae309 tempest-ListImageFiltersTestJSON-1021467922 tempest-ListImageFiltersTestJSON-1021467922-project-member] Enqueued Resource ID: 0defdd0d-cdbe-4a7c-9871-fd4c40a3847e with Priority: HIGHEST for action security_group_members [ 706.899713] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0defdd0d-cdbe-4a7c-9871-fd4c40a3847e with Priority: HIGHEST for action security_group_members [ 706.900161] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-0defdd0d-cdbe-4a7c-9871-fd4c40a3847e taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.900161] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0defdd0d-cdbe-4a7c-9871-fd4c40a3847e" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.982884] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6951f012-9730-40bd-a7af-9b70cd598b05 in Status: SUCCESS [ 706.982884] env[65306]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6951f012-9730-40bd-a7af-9b70cd598b05 deletion is rescheduled due to dependency. [ 706.982884] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6951f012-9730-40bd-a7af-9b70cd598b05" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.032132] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.032267] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.032333] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.032536] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.032625] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.033937] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7e20e218-e28d-40e6-a0ff-450ebaa5124b already deleted. [ 707.033937] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7e20e218-e28d-40e6-a0ff-450ebaa5124b" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.198745] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0defdd0d-cdbe-4a7c-9871-fd4c40a3847e',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 707.346156] env[65306]: INFO networking_nsxv3.common.synchronization [None req-26e35c58-afee-4f32-a155-9ccc7c46392b tempest-ServersV294TestFqdnHostnames-853342652 tempest-ServersV294TestFqdnHostnames-853342652-project-member] Enqueued Resource ID: 18bb45c8-7cab-44a5-887c-82deb65b8e26 with Priority: HIGHEST for action security_group_rules [ 707.346156] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 18bb45c8-7cab-44a5-887c-82deb65b8e26 with Priority: HIGHEST for action security_group_rules [ 707.346406] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock rules-18bb45c8-7cab-44a5-887c-82deb65b8e26 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.346504] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-18bb45c8-7cab-44a5-887c-82deb65b8e26" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.346535] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-18bb45c8-7cab-44a5-887c-82deb65b8e26" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.346892] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-18bb45c8-7cab-44a5-887c-82deb65b8e26" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.346975] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('18bb45c8-7cab-44a5-887c-82deb65b8e26',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 707.358875] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock network-707 taken with stack trace [, , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.359088] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "network-707" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.359208] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "network-707" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.359554] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "network-707" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.359735] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.359886] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.360044] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.360561] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.360715] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.361101] env[65306]: DEBUG dogpile.cache.region [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] No value present for key: 'zone-id' {{(pid=65306) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 707.361101] env[65306]: DEBUG dogpile.lock [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] NeedRegenerationException {{(pid=65306) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 707.361197] env[65306]: DEBUG dogpile.lock [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] no value, waiting for create lock {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 707.361228] env[65306]: DEBUG dogpile.lock [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] value creation lock acquired {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 707.361313] env[65306]: DEBUG dogpile.cache.region [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] No value present for key: 'zone-id' {{(pid=65306) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 707.361408] env[65306]: DEBUG dogpile.lock [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Calling creation function for not-yet-present value {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 707.361546] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 707.386976] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 707.386976] env[65306]: DEBUG dogpile.cache.region [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=65306) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 707.386976] env[65306]: DEBUG dogpile.lock [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Released creation lock {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 707.386976] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "network-707" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.386976] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock port-a46c2305-76b3-4401-a1c3-f6ef79698843 taken with stack trace [, , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.387290] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "port-a46c2305-76b3-4401-a1c3-f6ef79698843" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.387290] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "port-a46c2305-76b3-4401-a1c3-f6ef79698843" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.387584] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "port-a46c2305-76b3-4401-a1c3-f6ef79698843" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.387711] env[65306]: DEBUG networking_nsxv3.api.rpc [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a46c2305-76b3-4401-a1c3-f6ef79698843',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 707.400108] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5b30762c-ff29-4860-8c28-b0bdc8b21ef8 [ 707.400350] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.402085] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.402085] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.402085] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.402085] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.402085] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5b30762c-ff29-4860-8c28-b0bdc8b21ef8 already deleted. [ 707.402085] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5b30762c-ff29-4860-8c28-b0bdc8b21ef8" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.616792] env[65306]: INFO networking_nsxv3.common.synchronization [None req-9653e2e6-10da-4cd5-aa2f-10c6ae8fb370 tempest-ServersV294TestFqdnHostnames-853342652 tempest-ServersV294TestFqdnHostnames-853342652-project-member] Enqueued Resource ID: 18bb45c8-7cab-44a5-887c-82deb65b8e26 with Priority: HIGHEST for action security_group_rules [ 707.617277] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 18bb45c8-7cab-44a5-887c-82deb65b8e26 with Priority: HIGHEST for action security_group_rules [ 707.617631] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock rules-18bb45c8-7cab-44a5-887c-82deb65b8e26 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.617735] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-18bb45c8-7cab-44a5-887c-82deb65b8e26" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.702562] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.702733] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.702733] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.702926] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.703039] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.703141] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0defdd0d-cdbe-4a7c-9871-fd4c40a3847e is going to be created. [ 707.727206] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.727350] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.727787] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.727849] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.728417] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.739314] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0defdd0d-cdbe-4a7c-9871-fd4c40a3847e in Status: UNINITIALIZED for 2s [ 707.796043] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5ec09b70-aa5a-48ff-b72f-a5c6c81190e0 in Status: SUCCESS [ 707.796277] env[65306]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5ec09b70-aa5a-48ff-b72f-a5c6c81190e0 deletion is rescheduled due to dependency. [ 707.796407] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5ec09b70-aa5a-48ff-b72f-a5c6c81190e0" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.874052] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.874052] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.874052] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.874052] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.874052] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.874052] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 18bb45c8-7cab-44a5-887c-82deb65b8e26 already deleted. [ 707.874052] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-18bb45c8-7cab-44a5-887c-82deb65b8e26" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.874052] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-18bb45c8-7cab-44a5-887c-82deb65b8e26" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.874052] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-18bb45c8-7cab-44a5-887c-82deb65b8e26" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.874052] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('18bb45c8-7cab-44a5-887c-82deb65b8e26',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 707.890633] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.890633] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.890633] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.891581] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.891581] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.891581] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Segment Port a46c2305-76b3-4401-a1c3-f6ef79698843 not found, creating... [ 707.891581] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.891790] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.892671] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.892671] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.892671] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.892671] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.892930] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.892930] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.893039] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.893486] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.893486] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Resource: SegmentPort with ID: a46c2305-76b3-4401-a1c3-f6ef79698843 is going to be created. [ 707.926809] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.926809] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.926809] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.926809] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.926809] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.926809] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "port-a46c2305-76b3-4401-a1c3-f6ef79698843" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.395602] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.395794] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.395982] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.396187] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.396338] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.396452] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 18bb45c8-7cab-44a5-887c-82deb65b8e26 already deleted. [ 708.396578] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-18bb45c8-7cab-44a5-887c-82deb65b8e26" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.420090] env[65306]: INFO networking_nsxv3.common.synchronization [None req-4f4710b0-f84c-4928-b2a8-89ce733c0f3d tempest-MigrationsAdminTest-1842265666 tempest-MigrationsAdminTest-1842265666-project-member] Enqueued Resource ID: bbb563aa-82be-4451-bb54-943f58cba70f with Priority: HIGHEST for action security_group_rules [ 708.422231] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bbb563aa-82be-4451-bb54-943f58cba70f with Priority: HIGHEST for action security_group_rules [ 708.422231] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bbb563aa-82be-4451-bb54-943f58cba70f taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.422231] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bbb563aa-82be-4451-bb54-943f58cba70f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.422231] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bbb563aa-82be-4451-bb54-943f58cba70f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.422231] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bbb563aa-82be-4451-bb54-943f58cba70f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.422231] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bbb563aa-82be-4451-bb54-943f58cba70f',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 708.436051] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 55a6ae08-0730-4d04-bc2c-3f0c36758315 in Status: SUCCESS [ 708.436051] env[65306]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 55a6ae08-0730-4d04-bc2c-3f0c36758315 deletion is rescheduled due to dependency. [ 708.436147] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-55a6ae08-0730-4d04-bc2c-3f0c36758315" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.639314] env[65306]: INFO networking_nsxv3.common.synchronization [req-e2bced4a-7f8e-450a-8c02-bae8094290ed req-e992f9dc-bb73-4287-a63b-40bcdd2832e9 service nova] Enqueued Resource ID: 0defdd0d-cdbe-4a7c-9871-fd4c40a3847e with Priority: HIGHEST for action security_group_rules [ 708.639770] env[65306]: INFO networking_nsxv3.common.synchronization [req-e2bced4a-7f8e-450a-8c02-bae8094290ed req-e992f9dc-bb73-4287-a63b-40bcdd2832e9 service nova] Enqueued Resource ID: 0defdd0d-cdbe-4a7c-9871-fd4c40a3847e with Priority: HIGHEST for action security_group_members [ 708.639770] env[65306]: INFO networking_nsxv3.common.synchronization [req-e2bced4a-7f8e-450a-8c02-bae8094290ed req-e992f9dc-bb73-4287-a63b-40bcdd2832e9 service nova] Enqueued Resource ID: a46c2305-76b3-4401-a1c3-f6ef79698843 with Priority: HIGHEST for action port [ 708.640253] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0defdd0d-cdbe-4a7c-9871-fd4c40a3847e with Priority: HIGHEST for action security_group_rules [ 708.640941] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0defdd0d-cdbe-4a7c-9871-fd4c40a3847e with Priority: HIGHEST for action security_group_members [ 708.640941] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a46c2305-76b3-4401-a1c3-f6ef79698843 with Priority: HIGHEST for action port [ 708.640941] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0defdd0d-cdbe-4a7c-9871-fd4c40a3847e taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.641081] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0defdd0d-cdbe-4a7c-9871-fd4c40a3847e" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.641307] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-0defdd0d-cdbe-4a7c-9871-fd4c40a3847e taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.641425] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0defdd0d-cdbe-4a7c-9871-fd4c40a3847e" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.641632] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock port-a46c2305-76b3-4401-a1c3-f6ef79698843 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.641732] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a46c2305-76b3-4401-a1c3-f6ef79698843" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.641810] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a46c2305-76b3-4401-a1c3-f6ef79698843" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.642735] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a46c2305-76b3-4401-a1c3-f6ef79698843" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.642735] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a46c2305-76b3-4401-a1c3-f6ef79698843',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 708.851624] env[65306]: INFO networking_nsxv3.common.synchronization [None req-3503ebec-8108-4f7f-a463-316132dfaa3e tempest-MigrationsAdminTest-1842265666 tempest-MigrationsAdminTest-1842265666-project-member] Enqueued Resource ID: bbb563aa-82be-4451-bb54-943f58cba70f with Priority: HIGHEST for action security_group_rules [ 708.852177] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bbb563aa-82be-4451-bb54-943f58cba70f with Priority: HIGHEST for action security_group_rules [ 708.852487] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bbb563aa-82be-4451-bb54-943f58cba70f taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.852616] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bbb563aa-82be-4451-bb54-943f58cba70f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.944324] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.944523] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.944523] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.944741] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.944847] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.944957] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bbb563aa-82be-4451-bb54-943f58cba70f already deleted. [ 708.945084] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bbb563aa-82be-4451-bb54-943f58cba70f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.945315] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bbb563aa-82be-4451-bb54-943f58cba70f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.945587] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bbb563aa-82be-4451-bb54-943f58cba70f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.945640] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bbb563aa-82be-4451-bb54-943f58cba70f',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 709.145807] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a46c2305-76b3-4401-a1c3-f6ef79698843 with status ACTIVE [ 709.146200] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.146469] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.146529] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.147359] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.147359] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.147359] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.147359] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.147359] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.147594] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.147696] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.147903] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.148069] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.148123] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.148261] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.148386] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.148424] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a46c2305-76b3-4401-a1c3-f6ef79698843 is going to be updated. [ 709.188224] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.188392] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.188474] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.188656] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.188800] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.188957] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a46c2305-76b3-4401-a1c3-f6ef79698843" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.467218] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.467368] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.467435] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.468126] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.468492] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.468609] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bbb563aa-82be-4451-bb54-943f58cba70f already deleted. [ 709.468861] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bbb563aa-82be-4451-bb54-943f58cba70f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.750380] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0defdd0d-cdbe-4a7c-9871-fd4c40a3847e in Status: SUCCESS [ 709.750692] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0defdd0d-cdbe-4a7c-9871-fd4c40a3847e" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.750930] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0defdd0d-cdbe-4a7c-9871-fd4c40a3847e" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.751060] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0defdd0d-cdbe-4a7c-9871-fd4c40a3847e" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.751278] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.751365] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.751562] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.751621] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.751651] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.751728] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0defdd0d-cdbe-4a7c-9871-fd4c40a3847e" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.751847] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0defdd0d-cdbe-4a7c-9871-fd4c40a3847e',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 709.753337] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0defdd0d-cdbe-4a7c-9871-fd4c40a3847e" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.753337] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0defdd0d-cdbe-4a7c-9871-fd4c40a3847e" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.753337] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.753337] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.753337] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.753337] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.753536] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.753536] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0defdd0d-cdbe-4a7c-9871-fd4c40a3847e',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 710.133295] env[65306]: INFO networking_nsxv3.common.synchronization [req-2f95bf91-b59f-41e3-87aa-09654923c5d9 req-28400ec0-2f53-4d15-b705-3a1557803bc4 tempest-SecurityGroupsTestJSON-960025904 tempest-SecurityGroupsTestJSON-960025904-project-member] Enqueued Resource ID: 4e234e08-a192-4c7a-badf-3e57629854d7 with Priority: HIGHEST for action security_group_members [ 710.133957] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4e234e08-a192-4c7a-badf-3e57629854d7 with Priority: HIGHEST for action security_group_members [ 710.134820] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-4e234e08-a192-4c7a-badf-3e57629854d7 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.135068] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4e234e08-a192-4c7a-badf-3e57629854d7" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.135376] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4e234e08-a192-4c7a-badf-3e57629854d7" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.135719] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4e234e08-a192-4c7a-badf-3e57629854d7" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.135956] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.136219] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.136400] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.136851] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.137016] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.137170] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4e234e08-a192-4c7a-badf-3e57629854d7',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 710.256288] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-0defdd0d-cdbe-4a7c-9871-fd4c40a3847e taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.256434] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0defdd0d-cdbe-4a7c-9871-fd4c40a3847e" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.256633] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0defdd0d-cdbe-4a7c-9871-fd4c40a3847e',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 710.630190] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock network-504 taken with stack trace [, , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.630375] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "network-504" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.630532] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "network-504" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.630858] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "network-504" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.631123] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.631275] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.631384] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.631735] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.631880] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.632120] env[65306]: DEBUG dogpile.cache.region [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] No value present for key: 'zone-id' {{(pid=65306) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 710.632227] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] NeedRegenerationException {{(pid=65306) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 710.632350] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] no value, waiting for create lock {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 710.632456] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] value creation lock acquired {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 710.632600] env[65306]: DEBUG dogpile.cache.region [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] No value present for key: 'zone-id' {{(pid=65306) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 710.632725] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Calling creation function for not-yet-present value {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 710.632853] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 710.639822] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.640100] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.640100] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.640426] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.640426] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.640624] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.640708] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.640809] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.641044] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.641369] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.641468] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4e234e08-a192-4c7a-badf-3e57629854d7 already deleted. [ 710.641561] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4e234e08-a192-4c7a-badf-3e57629854d7" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.653033] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 710.653195] env[65306]: DEBUG dogpile.cache.region [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65306) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 710.653316] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Released creation lock {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 710.653489] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "network-504" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.653807] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock port-0ff68b46-78c7-46d5-a67b-1f11d60599cc taken with stack trace [, , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.653977] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "port-0ff68b46-78c7-46d5-a67b-1f11d60599cc" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.654117] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "port-0ff68b46-78c7-46d5-a67b-1f11d60599cc" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.654424] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "port-0ff68b46-78c7-46d5-a67b-1f11d60599cc" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.654569] env[65306]: DEBUG networking_nsxv3.api.rpc [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0ff68b46-78c7-46d5-a67b-1f11d60599cc',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 710.760803] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0defdd0d-cdbe-4a7c-9871-fd4c40a3847e',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 711.068525] env[65306]: INFO networking_nsxv3.common.synchronization [None req-cfb2e5a1-6aac-4ef2-a2b2-ef5802859390 None None] Enqueued Resource ID: 0f071e98-e759-433d-a151-f5d21c3bb243 with Priority: HIGHEST for action port [ 711.069123] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0f071e98-e759-433d-a151-f5d21c3bb243 with Priority: HIGHEST for action port [ 711.069548] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock port-0f071e98-e759-433d-a151-f5d21c3bb243 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.069892] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0f071e98-e759-433d-a151-f5d21c3bb243" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.069892] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0f071e98-e759-433d-a151-f5d21c3bb243" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.070144] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0f071e98-e759-433d-a151-f5d21c3bb243" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.070279] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0f071e98-e759-433d-a151-f5d21c3bb243',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 711.160021] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.160300] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.160426] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.160732] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.160952] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.161030] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Segment Port 0ff68b46-78c7-46d5-a67b-1f11d60599cc not found, creating... [ 711.161303] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.161477] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.161629] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.161888] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.162024] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.162368] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.162538] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.162652] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.162890] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.162985] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.163135] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Resource: SegmentPort with ID: 0ff68b46-78c7-46d5-a67b-1f11d60599cc is going to be created. [ 711.187240] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.187564] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.187564] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.187828] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.188065] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.188280] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "port-0ff68b46-78c7-46d5-a67b-1f11d60599cc" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.264257] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.264378] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.264470] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.264666] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.264782] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.264852] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0defdd0d-cdbe-4a7c-9871-fd4c40a3847e is going to be updated. [ 711.327154] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.327505] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.327505] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.327630] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.327808] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.343194] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0defdd0d-cdbe-4a7c-9871-fd4c40a3847e in Status: IN_PROGRESS for 2s [ 711.572177] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0f071e98-e759-433d-a151-f5d21c3bb243 [ 711.572693] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.572845] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.572955] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.573216] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.573300] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.573396] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0f071e98-e759-433d-a151-f5d21c3bb243 already deleted. [ 711.573481] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0f071e98-e759-433d-a151-f5d21c3bb243" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.894879] env[65306]: INFO networking_nsxv3.common.synchronization [req-2f95bf91-b59f-41e3-87aa-09654923c5d9 req-9f51c6fb-329f-4806-ba47-c23a1ffbb87f service nova] Enqueued Resource ID: 4e234e08-a192-4c7a-badf-3e57629854d7 with Priority: HIGHEST for action security_group_rules [ 711.895212] env[65306]: INFO networking_nsxv3.common.synchronization [req-2f95bf91-b59f-41e3-87aa-09654923c5d9 req-9f51c6fb-329f-4806-ba47-c23a1ffbb87f service nova] Enqueued Resource ID: 4e234e08-a192-4c7a-badf-3e57629854d7 with Priority: HIGHEST for action security_group_members [ 711.895371] env[65306]: INFO networking_nsxv3.common.synchronization [req-2f95bf91-b59f-41e3-87aa-09654923c5d9 req-9f51c6fb-329f-4806-ba47-c23a1ffbb87f service nova] Enqueued Resource ID: 0ff68b46-78c7-46d5-a67b-1f11d60599cc with Priority: HIGHEST for action port [ 711.895992] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4e234e08-a192-4c7a-badf-3e57629854d7 with Priority: HIGHEST for action security_group_rules [ 711.897516] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4e234e08-a192-4c7a-badf-3e57629854d7 with Priority: HIGHEST for action security_group_members [ 711.897668] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0ff68b46-78c7-46d5-a67b-1f11d60599cc with Priority: HIGHEST for action port [ 711.898025] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4e234e08-a192-4c7a-badf-3e57629854d7 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.898174] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4e234e08-a192-4c7a-badf-3e57629854d7" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.898255] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4e234e08-a192-4c7a-badf-3e57629854d7" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.899967] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4e234e08-a192-4c7a-badf-3e57629854d7" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.900107] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4e234e08-a192-4c7a-badf-3e57629854d7',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 711.901550] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-4e234e08-a192-4c7a-badf-3e57629854d7 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.903070] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4e234e08-a192-4c7a-badf-3e57629854d7" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.904202] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4e234e08-a192-4c7a-badf-3e57629854d7" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.904202] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4e234e08-a192-4c7a-badf-3e57629854d7" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.904202] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.904369] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.904369] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.904519] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.904583] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.904670] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4e234e08-a192-4c7a-badf-3e57629854d7',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 711.905641] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock port-0ff68b46-78c7-46d5-a67b-1f11d60599cc taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.905762] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0ff68b46-78c7-46d5-a67b-1f11d60599cc" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.905816] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0ff68b46-78c7-46d5-a67b-1f11d60599cc" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.906027] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0ff68b46-78c7-46d5-a67b-1f11d60599cc" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.906152] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0ff68b46-78c7-46d5-a67b-1f11d60599cc',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 712.410875] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-4e234e08-a192-4c7a-badf-3e57629854d7 taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.411136] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4e234e08-a192-4c7a-badf-3e57629854d7" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.411247] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4e234e08-a192-4c7a-badf-3e57629854d7',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 712.412215] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0ff68b46-78c7-46d5-a67b-1f11d60599cc with status ACTIVE [ 712.412407] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.412547] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.412615] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.412840] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.412934] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.413147] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.413256] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.413318] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.413505] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.413590] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.413790] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.413899] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.413964] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.415039] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.415039] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.415039] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0ff68b46-78c7-46d5-a67b-1f11d60599cc is going to be updated. [ 712.439550] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.439803] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.439803] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.440102] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.440253] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.440462] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0ff68b46-78c7-46d5-a67b-1f11d60599cc" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.917436] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4e234e08-a192-4c7a-badf-3e57629854d7',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 713.354803] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0defdd0d-cdbe-4a7c-9871-fd4c40a3847e in Status: SUCCESS [ 713.355624] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0defdd0d-cdbe-4a7c-9871-fd4c40a3847e" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.355624] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0defdd0d-cdbe-4a7c-9871-fd4c40a3847e" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.355624] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0defdd0d-cdbe-4a7c-9871-fd4c40a3847e" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.356593] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.356593] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.356593] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.356593] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.356593] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.356593] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0defdd0d-cdbe-4a7c-9871-fd4c40a3847e',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 713.424162] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.424162] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.424162] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.424162] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.424162] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.424407] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4e234e08-a192-4c7a-badf-3e57629854d7 is going to be created. [ 713.452486] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.452742] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.452896] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.453105] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.453215] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.466796] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4e234e08-a192-4c7a-badf-3e57629854d7 in Status: UNINITIALIZED for 2s [ 713.775081] env[65306]: INFO networking_nsxv3.common.synchronization [None req-4cb572bf-ef77-4d4d-ad09-2b2cb236b3f5 None None] Enqueued Resource ID: ed8aea5a-9543-426f-93a9-fcb50b19e113 with Priority: HIGHEST for action port [ 713.775081] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ed8aea5a-9543-426f-93a9-fcb50b19e113 with Priority: HIGHEST for action port [ 713.775081] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock port-ed8aea5a-9543-426f-93a9-fcb50b19e113 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.775081] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ed8aea5a-9543-426f-93a9-fcb50b19e113" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.775081] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ed8aea5a-9543-426f-93a9-fcb50b19e113" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.776519] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ed8aea5a-9543-426f-93a9-fcb50b19e113" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.776622] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ed8aea5a-9543-426f-93a9-fcb50b19e113',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 713.859572] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0defdd0d-cdbe-4a7c-9871-fd4c40a3847e',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 714.198209] env[65306]: INFO networking_nsxv3.common.synchronization [None req-cda57996-d82e-47b8-9d02-f474866e63ab None None] Enqueued Resource ID: 685d24a9-6c98-468d-b9df-67ee2123d2a2 with Priority: HIGHEST for action port [ 714.198209] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 685d24a9-6c98-468d-b9df-67ee2123d2a2 with Priority: HIGHEST for action port [ 714.198530] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock port-685d24a9-6c98-468d-b9df-67ee2123d2a2 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.198530] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-685d24a9-6c98-468d-b9df-67ee2123d2a2" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.198615] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-685d24a9-6c98-468d-b9df-67ee2123d2a2" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.198854] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-685d24a9-6c98-468d-b9df-67ee2123d2a2" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.198975] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('685d24a9-6c98-468d-b9df-67ee2123d2a2',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 714.282886] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ed8aea5a-9543-426f-93a9-fcb50b19e113 [ 714.283099] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.283249] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.283318] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.283541] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.283639] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.283735] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ed8aea5a-9543-426f-93a9-fcb50b19e113 already deleted. [ 714.283813] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ed8aea5a-9543-426f-93a9-fcb50b19e113" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.363216] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0defdd0d-cdbe-4a7c-9871-fd4c40a3847e',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 714.702808] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 685d24a9-6c98-468d-b9df-67ee2123d2a2 [ 714.703106] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.703238] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.703279] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.703605] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.703748] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.703896] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:685d24a9-6c98-468d-b9df-67ee2123d2a2 already deleted. [ 714.703999] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-685d24a9-6c98-468d-b9df-67ee2123d2a2" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.866630] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.866803] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.866912] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.867109] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.867201] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.867303] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0defdd0d-cdbe-4a7c-9871-fd4c40a3847e is going to be updated. [ 714.902346] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.902562] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.902665] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.902878] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.903040] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.917904] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0defdd0d-cdbe-4a7c-9871-fd4c40a3847e in Status: IN_PROGRESS for 2s [ 715.480131] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4e234e08-a192-4c7a-badf-3e57629854d7 in Status: SUCCESS [ 715.480446] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4e234e08-a192-4c7a-badf-3e57629854d7" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.480632] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4e234e08-a192-4c7a-badf-3e57629854d7" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.484113] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4e234e08-a192-4c7a-badf-3e57629854d7" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.484113] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.484113] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.484113] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.484113] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.484113] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.484113] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4e234e08-a192-4c7a-badf-3e57629854d7" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.484113] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4e234e08-a192-4c7a-badf-3e57629854d7',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 715.985045] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-4e234e08-a192-4c7a-badf-3e57629854d7 taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.985045] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4e234e08-a192-4c7a-badf-3e57629854d7" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.985045] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4e234e08-a192-4c7a-badf-3e57629854d7" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.985379] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4e234e08-a192-4c7a-badf-3e57629854d7" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.985474] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.985587] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.985669] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.985836] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.985928] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.986043] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4e234e08-a192-4c7a-badf-3e57629854d7" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.986219] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-4e234e08-a192-4c7a-badf-3e57629854d7 taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.986332] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4e234e08-a192-4c7a-badf-3e57629854d7" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.986413] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4e234e08-a192-4c7a-badf-3e57629854d7" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.986576] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4e234e08-a192-4c7a-badf-3e57629854d7" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.986733] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.986827] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.986880] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.987050] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.987143] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.987225] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4e234e08-a192-4c7a-badf-3e57629854d7" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.987320] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4e234e08-a192-4c7a-badf-3e57629854d7',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 716.492203] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4e234e08-a192-4c7a-badf-3e57629854d7: rpc.has_security_group_logging(os_id): False [ 716.515171] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.515171] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.515171] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.515171] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.515171] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.515171] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.515171] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.515171] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.515171] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.515171] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.515553] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.515553] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.515553] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.515642] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.515700] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.515881] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.515971] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.517163] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.517521] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.517720] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.517900] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4e234e08-a192-4c7a-badf-3e57629854d7 is going to be created. [ 716.587968] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.591019] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.591019] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.591019] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.591019] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.620925] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4e234e08-a192-4c7a-badf-3e57629854d7 in Status: IN_PROGRESS for 2s [ 716.937071] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0defdd0d-cdbe-4a7c-9871-fd4c40a3847e in Status: SUCCESS [ 716.937071] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0defdd0d-cdbe-4a7c-9871-fd4c40a3847e" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.937071] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0defdd0d-cdbe-4a7c-9871-fd4c40a3847e" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.937071] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0defdd0d-cdbe-4a7c-9871-fd4c40a3847e" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.937071] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.937254] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.937254] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.937593] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.937676] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.937734] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0defdd0d-cdbe-4a7c-9871-fd4c40a3847e" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.937928] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-0defdd0d-cdbe-4a7c-9871-fd4c40a3847e taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.940261] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0defdd0d-cdbe-4a7c-9871-fd4c40a3847e" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.940261] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0defdd0d-cdbe-4a7c-9871-fd4c40a3847e" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.940487] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0defdd0d-cdbe-4a7c-9871-fd4c40a3847e" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.940913] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.940913] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.940913] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.941810] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.941810] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.941810] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0defdd0d-cdbe-4a7c-9871-fd4c40a3847e" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.941810] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0defdd0d-cdbe-4a7c-9871-fd4c40a3847e',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 717.050163] env[65306]: INFO networking_nsxv3.common.synchronization [None req-a7398218-7dcb-48e3-a42e-71db8b3f5177 None None] Enqueued Resource ID: 94f027e9-10b4-469a-959d-6c82b0e06452 with Priority: HIGHEST for action port [ 717.052630] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 94f027e9-10b4-469a-959d-6c82b0e06452 with Priority: HIGHEST for action port [ 717.052777] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock port-94f027e9-10b4-469a-959d-6c82b0e06452 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.052893] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-94f027e9-10b4-469a-959d-6c82b0e06452" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.052893] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-94f027e9-10b4-469a-959d-6c82b0e06452" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.053235] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-94f027e9-10b4-469a-959d-6c82b0e06452" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.053235] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('94f027e9-10b4-469a-959d-6c82b0e06452',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 717.447261] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0defdd0d-cdbe-4a7c-9871-fd4c40a3847e: rpc.has_security_group_logging(os_id): False [ 717.477063] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.477063] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.477063] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.477063] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.477063] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.477063] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.477063] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.477063] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.477063] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.477063] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.477063] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.477063] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.477063] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.477063] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.477063] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.477919] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.479826] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.479994] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.480334] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.480505] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.480664] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0defdd0d-cdbe-4a7c-9871-fd4c40a3847e is going to be created. [ 717.546641] env[65306]: INFO networking_nsxv3.common.synchronization [None req-046fcfe0-6fb2-4fc2-a78c-cf4760d4a76f None None] Enqueued Resource ID: b0e4a549-2490-4f80-bea9-607b6fa75e46 with Priority: HIGHEST for action port [ 717.547278] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b0e4a549-2490-4f80-bea9-607b6fa75e46 with Priority: HIGHEST for action port [ 717.547636] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock port-b0e4a549-2490-4f80-bea9-607b6fa75e46 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.547764] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b0e4a549-2490-4f80-bea9-607b6fa75e46" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.547825] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b0e4a549-2490-4f80-bea9-607b6fa75e46" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.551114] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b0e4a549-2490-4f80-bea9-607b6fa75e46" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.551114] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b0e4a549-2490-4f80-bea9-607b6fa75e46',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 717.556562] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 94f027e9-10b4-469a-959d-6c82b0e06452 [ 717.556649] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.557021] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.557021] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.557125] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.557125] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.557125] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:94f027e9-10b4-469a-959d-6c82b0e06452 already deleted. [ 717.557125] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-94f027e9-10b4-469a-959d-6c82b0e06452" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.635725] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.635725] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.635725] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.635725] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.635725] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.647880] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0defdd0d-cdbe-4a7c-9871-fd4c40a3847e in Status: IN_PROGRESS for 2s [ 717.903932] env[65306]: INFO networking_nsxv3.common.synchronization [None req-3d9f7b60-7632-4813-b86a-4c9f3b205559 tempest-ServersTestBootFromVolume-1537688806 tempest-ServersTestBootFromVolume-1537688806-project-member] Enqueued Resource ID: c3ffb1bc-84c3-4121-a677-8d413e70c9cc with Priority: HIGHEST for action security_group_rules [ 717.903932] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c3ffb1bc-84c3-4121-a677-8d413e70c9cc with Priority: HIGHEST for action security_group_rules [ 717.904388] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c3ffb1bc-84c3-4121-a677-8d413e70c9cc taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.904388] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c3ffb1bc-84c3-4121-a677-8d413e70c9cc" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.904388] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c3ffb1bc-84c3-4121-a677-8d413e70c9cc" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.904583] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c3ffb1bc-84c3-4121-a677-8d413e70c9cc" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.904666] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c3ffb1bc-84c3-4121-a677-8d413e70c9cc',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 718.054739] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b0e4a549-2490-4f80-bea9-607b6fa75e46 [ 718.054996] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.055234] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.055234] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.055446] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.055597] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.055597] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b0e4a549-2490-4f80-bea9-607b6fa75e46 already deleted. [ 718.055686] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b0e4a549-2490-4f80-bea9-607b6fa75e46" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.076451] env[65306]: INFO networking_nsxv3.common.synchronization [None req-91608671-8f5f-439b-98a8-0d593368fcd9 tempest-ServersTestBootFromVolume-1537688806 tempest-ServersTestBootFromVolume-1537688806-project-member] Enqueued Resource ID: c3ffb1bc-84c3-4121-a677-8d413e70c9cc with Priority: HIGHEST for action security_group_rules [ 718.077079] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c3ffb1bc-84c3-4121-a677-8d413e70c9cc with Priority: HIGHEST for action security_group_rules [ 718.077461] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c3ffb1bc-84c3-4121-a677-8d413e70c9cc taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.077581] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c3ffb1bc-84c3-4121-a677-8d413e70c9cc" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.162735] env[65306]: INFO networking_nsxv3.common.synchronization [req-de294f2b-7d0a-4123-aba7-1fca66bb1015 req-0b2f06b1-41c2-4035-acdc-318435c2316c tempest-SecurityGroupRulesTestJSON-350827756 tempest-SecurityGroupRulesTestJSON-350827756-project-member] Enqueued Resource ID: 62f14b0d-589b-44b4-8ca9-63533866175d with Priority: HIGHEST for action security_group_rules [ 718.163745] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 62f14b0d-589b-44b4-8ca9-63533866175d with Priority: HIGHEST for action security_group_rules [ 718.163745] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock rules-62f14b0d-589b-44b4-8ca9-63533866175d taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.163745] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-62f14b0d-589b-44b4-8ca9-63533866175d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.163745] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-62f14b0d-589b-44b4-8ca9-63533866175d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.164014] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-62f14b0d-589b-44b4-8ca9-63533866175d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.164103] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('62f14b0d-589b-44b4-8ca9-63533866175d',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 718.425876] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.426327] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.426327] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.426460] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.426460] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.426544] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c3ffb1bc-84c3-4121-a677-8d413e70c9cc already deleted. [ 718.426627] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c3ffb1bc-84c3-4121-a677-8d413e70c9cc" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.427206] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c3ffb1bc-84c3-4121-a677-8d413e70c9cc" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.427967] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c3ffb1bc-84c3-4121-a677-8d413e70c9cc" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.427967] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c3ffb1bc-84c3-4121-a677-8d413e70c9cc',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 718.636292] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4e234e08-a192-4c7a-badf-3e57629854d7 in Status: SUCCESS [ 718.637266] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4e234e08-a192-4c7a-badf-3e57629854d7" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.692035] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.692035] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.692035] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.692035] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.692035] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.692035] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 62f14b0d-589b-44b4-8ca9-63533866175d already deleted. [ 718.692035] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-62f14b0d-589b-44b4-8ca9-63533866175d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.954327] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.954690] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.955025] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.955711] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.955833] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.955938] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c3ffb1bc-84c3-4121-a677-8d413e70c9cc already deleted. [ 718.956094] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c3ffb1bc-84c3-4121-a677-8d413e70c9cc" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.663238] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0defdd0d-cdbe-4a7c-9871-fd4c40a3847e in Status: SUCCESS [ 719.663616] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0defdd0d-cdbe-4a7c-9871-fd4c40a3847e" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.664769] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0defdd0d-cdbe-4a7c-9871-fd4c40a3847e" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.664769] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0defdd0d-cdbe-4a7c-9871-fd4c40a3847e" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.664769] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0defdd0d-cdbe-4a7c-9871-fd4c40a3847e',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 720.016453] env[65306]: INFO networking_nsxv3.common.synchronization [req-e040dac9-5823-4a2f-b918-8573575b6af1 req-a624ecfc-1e39-4840-b3bf-c0e91524e536 tempest-ServersAdminNegativeTestJSON-1507119040 tempest-ServersAdminNegativeTestJSON-1507119040-project-member] Enqueued Resource ID: e3e0f6b2-2984-4938-adcc-0374a714ff76 with Priority: HIGHEST for action security_group_members [ 720.017059] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e3e0f6b2-2984-4938-adcc-0374a714ff76 with Priority: HIGHEST for action security_group_members [ 720.017406] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-e3e0f6b2-2984-4938-adcc-0374a714ff76 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.017584] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e3e0f6b2-2984-4938-adcc-0374a714ff76" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.017650] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e3e0f6b2-2984-4938-adcc-0374a714ff76" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.019247] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e3e0f6b2-2984-4938-adcc-0374a714ff76" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.019450] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.019658] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.019738] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.020880] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.020880] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.020880] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e3e0f6b2-2984-4938-adcc-0374a714ff76',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 720.172611] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-0defdd0d-cdbe-4a7c-9871-fd4c40a3847e taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.172847] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0defdd0d-cdbe-4a7c-9871-fd4c40a3847e" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.172929] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0defdd0d-cdbe-4a7c-9871-fd4c40a3847e" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.173266] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0defdd0d-cdbe-4a7c-9871-fd4c40a3847e" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.173571] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.173694] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.174071] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.174071] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.174279] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.174431] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0defdd0d-cdbe-4a7c-9871-fd4c40a3847e" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.174624] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0defdd0d-cdbe-4a7c-9871-fd4c40a3847e',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 720.516234] env[65306]: INFO networking_nsxv3.common.synchronization [req-9da0ce82-46f6-482c-8cff-8226d5c3887c req-758f123a-6e49-4c74-affe-1b959d3969e2 tempest-SecurityGroupRulesTestJSON-350827756 tempest-SecurityGroupRulesTestJSON-350827756-project-member] Enqueued Resource ID: 62f14b0d-589b-44b4-8ca9-63533866175d with Priority: HIGHEST for action security_group_rules [ 720.516812] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 62f14b0d-589b-44b4-8ca9-63533866175d with Priority: HIGHEST for action security_group_rules [ 720.517476] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock rules-62f14b0d-589b-44b4-8ca9-63533866175d taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.517700] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-62f14b0d-589b-44b4-8ca9-63533866175d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.517804] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-62f14b0d-589b-44b4-8ca9-63533866175d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.520010] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-62f14b0d-589b-44b4-8ca9-63533866175d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.520162] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('62f14b0d-589b-44b4-8ca9-63533866175d',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 720.524976] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e3e0f6b2-2984-4938-adcc-0374a714ff76',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 720.678465] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-0defdd0d-cdbe-4a7c-9871-fd4c40a3847e taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.678799] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0defdd0d-cdbe-4a7c-9871-fd4c40a3847e" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.678799] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0defdd0d-cdbe-4a7c-9871-fd4c40a3847e" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.679036] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0defdd0d-cdbe-4a7c-9871-fd4c40a3847e" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.681182] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.681182] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.681182] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.681182] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.681182] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.681182] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0defdd0d-cdbe-4a7c-9871-fd4c40a3847e" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.681182] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-0defdd0d-cdbe-4a7c-9871-fd4c40a3847e taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.681182] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0defdd0d-cdbe-4a7c-9871-fd4c40a3847e" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.681182] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0defdd0d-cdbe-4a7c-9871-fd4c40a3847e" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.681182] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0defdd0d-cdbe-4a7c-9871-fd4c40a3847e" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.684849] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.684849] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.684849] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.684849] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.684849] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.684849] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0defdd0d-cdbe-4a7c-9871-fd4c40a3847e" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.684849] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0defdd0d-cdbe-4a7c-9871-fd4c40a3847e',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 720.777745] env[65306]: INFO networking_nsxv3.common.synchronization [None req-95953dab-289b-44c5-a226-4680a5e0edef None None] Enqueued Resource ID: 52935ae8-7f36-485c-98d4-4e1abf84c8b1 with Priority: HIGHEST for action port [ 720.778656] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 52935ae8-7f36-485c-98d4-4e1abf84c8b1 with Priority: HIGHEST for action port [ 720.778656] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock port-52935ae8-7f36-485c-98d4-4e1abf84c8b1 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.778833] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-52935ae8-7f36-485c-98d4-4e1abf84c8b1" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.778833] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-52935ae8-7f36-485c-98d4-4e1abf84c8b1" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.779047] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-52935ae8-7f36-485c-98d4-4e1abf84c8b1" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.779139] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('52935ae8-7f36-485c-98d4-4e1abf84c8b1',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 720.842825] env[65306]: INFO networking_nsxv3.common.synchronization [None req-72faca0d-1b63-4736-b0d9-c09b14a120c1 None None] Enqueued Resource ID: dd2881d5-b63d-430b-acf4-bdd965b49315 with Priority: HIGHEST for action port [ 720.845789] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dd2881d5-b63d-430b-acf4-bdd965b49315 with Priority: HIGHEST for action port [ 720.846090] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock port-dd2881d5-b63d-430b-acf4-bdd965b49315 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.846304] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-dd2881d5-b63d-430b-acf4-bdd965b49315" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.846304] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-dd2881d5-b63d-430b-acf4-bdd965b49315" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.846678] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-dd2881d5-b63d-430b-acf4-bdd965b49315" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.846678] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dd2881d5-b63d-430b-acf4-bdd965b49315',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 721.032202] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e3e0f6b2-2984-4938-adcc-0374a714ff76',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 721.053246] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.054209] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.054209] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.054209] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.054209] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.054209] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 62f14b0d-589b-44b4-8ca9-63533866175d already deleted. [ 721.054209] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-62f14b0d-589b-44b4-8ca9-63533866175d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.190031] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0defdd0d-cdbe-4a7c-9871-fd4c40a3847e: rpc.has_security_group_logging(os_id): False [ 721.212334] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.213144] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.213319] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.213641] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.213809] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.214153] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.214332] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.217283] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.217386] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.217496] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.217774] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.217889] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.217958] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.218171] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.218257] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.218515] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.218656] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.218741] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.218877] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.218956] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.219057] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0defdd0d-cdbe-4a7c-9871-fd4c40a3847e is going to be updated. [ 721.281927] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 52935ae8-7f36-485c-98d4-4e1abf84c8b1 [ 721.281927] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.284811] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.284811] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.284811] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.284811] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.284811] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:52935ae8-7f36-485c-98d4-4e1abf84c8b1 already deleted. [ 721.284811] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-52935ae8-7f36-485c-98d4-4e1abf84c8b1" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.287359] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.287517] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.287611] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.288932] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.288932] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.304978] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0defdd0d-cdbe-4a7c-9871-fd4c40a3847e in Status: IN_PROGRESS for 2s [ 721.352115] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port dd2881d5-b63d-430b-acf4-bdd965b49315 [ 721.352370] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.352505] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.352567] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.352783] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.352876] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.353611] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:dd2881d5-b63d-430b-acf4-bdd965b49315 already deleted. [ 721.353611] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-dd2881d5-b63d-430b-acf4-bdd965b49315" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.536132] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.536132] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.536132] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.536132] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.536132] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.536132] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e3e0f6b2-2984-4938-adcc-0374a714ff76 is going to be updated. [ 721.586534] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.586716] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.586813] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.587061] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.587246] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.600557] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e3e0f6b2-2984-4938-adcc-0374a714ff76 in Status: IN_PROGRESS for 2s [ 723.325501] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0defdd0d-cdbe-4a7c-9871-fd4c40a3847e in Status: SUCCESS [ 723.325720] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0defdd0d-cdbe-4a7c-9871-fd4c40a3847e" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.613053] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e3e0f6b2-2984-4938-adcc-0374a714ff76 in Status: SUCCESS [ 723.613053] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e3e0f6b2-2984-4938-adcc-0374a714ff76" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.779867] env[65306]: INFO networking_nsxv3.common.synchronization [None req-a0646a83-cfe3-4aad-a2bf-bffef3ffc306 tempest-ServerActionsV293TestJSON-2007661909 tempest-ServerActionsV293TestJSON-2007661909-project-member] Enqueued Resource ID: e21f899c-0473-418d-9b8f-8591e9dc160f with Priority: HIGHEST for action security_group_rules [ 723.779867] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e21f899c-0473-418d-9b8f-8591e9dc160f with Priority: HIGHEST for action security_group_rules [ 723.781484] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e21f899c-0473-418d-9b8f-8591e9dc160f taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.783646] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e21f899c-0473-418d-9b8f-8591e9dc160f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.783646] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e21f899c-0473-418d-9b8f-8591e9dc160f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.783646] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e21f899c-0473-418d-9b8f-8591e9dc160f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.783779] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e21f899c-0473-418d-9b8f-8591e9dc160f',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.908800] env[65306]: INFO networking_nsxv3.common.synchronization [None req-a421e7a7-1e74-4bad-9c0d-af062651a0c2 tempest-ServerActionsV293TestJSON-2007661909 tempest-ServerActionsV293TestJSON-2007661909-project-member] Enqueued Resource ID: e21f899c-0473-418d-9b8f-8591e9dc160f with Priority: HIGHEST for action security_group_rules [ 723.910406] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e21f899c-0473-418d-9b8f-8591e9dc160f with Priority: HIGHEST for action security_group_rules [ 723.910406] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e21f899c-0473-418d-9b8f-8591e9dc160f taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.910406] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e21f899c-0473-418d-9b8f-8591e9dc160f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.310163] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.310599] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.312522] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.312522] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.312522] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.312522] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e21f899c-0473-418d-9b8f-8591e9dc160f already deleted. [ 724.312522] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e21f899c-0473-418d-9b8f-8591e9dc160f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.312522] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e21f899c-0473-418d-9b8f-8591e9dc160f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.312522] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e21f899c-0473-418d-9b8f-8591e9dc160f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.312522] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e21f899c-0473-418d-9b8f-8591e9dc160f',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 724.843634] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.843634] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.843634] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.844199] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.844199] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.844290] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e21f899c-0473-418d-9b8f-8591e9dc160f already deleted. [ 724.848035] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e21f899c-0473-418d-9b8f-8591e9dc160f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.882602] env[65306]: INFO networking_nsxv3.common.synchronization [None req-bc3a6f7c-a7ed-4ee4-9d52-bf401f96226b None None] Enqueued Resource ID: b3248e49-50d2-421b-9e5e-6e364cb41d3e with Priority: HIGHEST for action port [ 724.883203] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b3248e49-50d2-421b-9e5e-6e364cb41d3e with Priority: HIGHEST for action port [ 724.884827] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock port-b3248e49-50d2-421b-9e5e-6e364cb41d3e taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.884827] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b3248e49-50d2-421b-9e5e-6e364cb41d3e" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.884827] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b3248e49-50d2-421b-9e5e-6e364cb41d3e" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.884827] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b3248e49-50d2-421b-9e5e-6e364cb41d3e" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.884827] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b3248e49-50d2-421b-9e5e-6e364cb41d3e',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 724.937802] env[65306]: INFO networking_nsxv3.common.synchronization [req-1375329a-62b3-4e25-be56-7c85a6a0d5b1 req-e9f39c48-bc5d-4648-aaf0-d586e7ff8458 tempest-SecurityGroupRulesTestJSON-350827756 tempest-SecurityGroupRulesTestJSON-350827756-project-member] Enqueued Resource ID: 62f14b0d-589b-44b4-8ca9-63533866175d with Priority: HIGHEST for action security_group_rules [ 724.939808] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 62f14b0d-589b-44b4-8ca9-63533866175d with Priority: HIGHEST for action security_group_rules [ 724.939808] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock rules-62f14b0d-589b-44b4-8ca9-63533866175d taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.939808] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-62f14b0d-589b-44b4-8ca9-63533866175d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.939808] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-62f14b0d-589b-44b4-8ca9-63533866175d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.942468] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-62f14b0d-589b-44b4-8ca9-63533866175d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.945995] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('62f14b0d-589b-44b4-8ca9-63533866175d',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 725.387406] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b3248e49-50d2-421b-9e5e-6e364cb41d3e [ 725.387406] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.387531] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.387561] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.387779] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.387873] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.387969] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b3248e49-50d2-421b-9e5e-6e364cb41d3e already deleted. [ 725.388069] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b3248e49-50d2-421b-9e5e-6e364cb41d3e" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.473680] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.474535] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.474535] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.474535] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.474535] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.474535] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 62f14b0d-589b-44b4-8ca9-63533866175d already deleted. [ 725.474535] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-62f14b0d-589b-44b4-8ca9-63533866175d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.877544] env[65306]: INFO networking_nsxv3.common.synchronization [req-8bc0865b-2cfd-499a-85a4-121693af7429 req-f14d59e0-6b15-4892-88e4-5d6b5470b8e9 tempest-SecurityGroupsTestJSON-960025904 tempest-SecurityGroupsTestJSON-960025904-project-member] Enqueued Resource ID: ca47d813-3b19-4aa2-8339-4f933a85963f with Priority: HIGHEST for action security_group_members [ 725.877544] env[65306]: INFO networking_nsxv3.common.synchronization [req-8bc0865b-2cfd-499a-85a4-121693af7429 req-f14d59e0-6b15-4892-88e4-5d6b5470b8e9 tempest-SecurityGroupsTestJSON-960025904 tempest-SecurityGroupsTestJSON-960025904-project-member] Enqueued Resource ID: 4e234e08-a192-4c7a-badf-3e57629854d7 with Priority: HIGHEST for action security_group_members [ 725.877544] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ca47d813-3b19-4aa2-8339-4f933a85963f with Priority: HIGHEST for action security_group_members [ 725.877544] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4e234e08-a192-4c7a-badf-3e57629854d7 with Priority: HIGHEST for action security_group_members [ 725.877544] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-ca47d813-3b19-4aa2-8339-4f933a85963f taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.878025] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ca47d813-3b19-4aa2-8339-4f933a85963f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.878025] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ca47d813-3b19-4aa2-8339-4f933a85963f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.878025] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ca47d813-3b19-4aa2-8339-4f933a85963f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.878388] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.878388] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.878518] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.879242] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.879242] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.879242] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ca47d813-3b19-4aa2-8339-4f933a85963f',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 725.880168] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-4e234e08-a192-4c7a-badf-3e57629854d7 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.880168] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4e234e08-a192-4c7a-badf-3e57629854d7" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.884172] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4e234e08-a192-4c7a-badf-3e57629854d7" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.884172] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4e234e08-a192-4c7a-badf-3e57629854d7" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.884172] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.884172] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.884172] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.884172] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.884172] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.884172] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4e234e08-a192-4c7a-badf-3e57629854d7',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 725.927869] env[65306]: INFO networking_nsxv3.common.synchronization [req-8bc0865b-2cfd-499a-85a4-121693af7429 req-f14d59e0-6b15-4892-88e4-5d6b5470b8e9 tempest-SecurityGroupsTestJSON-960025904 tempest-SecurityGroupsTestJSON-960025904-project-member] Enqueued Resource ID: 4e234e08-a192-4c7a-badf-3e57629854d7 with Priority: HIGHEST for action security_group_rules [ 725.928507] env[65306]: INFO networking_nsxv3.common.synchronization [req-8bc0865b-2cfd-499a-85a4-121693af7429 req-f14d59e0-6b15-4892-88e4-5d6b5470b8e9 tempest-SecurityGroupsTestJSON-960025904 tempest-SecurityGroupsTestJSON-960025904-project-member] Enqueued Resource ID: 4e234e08-a192-4c7a-badf-3e57629854d7 with Priority: HIGHEST for action security_group_members [ 725.928507] env[65306]: INFO networking_nsxv3.common.synchronization [req-8bc0865b-2cfd-499a-85a4-121693af7429 req-f14d59e0-6b15-4892-88e4-5d6b5470b8e9 tempest-SecurityGroupsTestJSON-960025904 tempest-SecurityGroupsTestJSON-960025904-project-member] Enqueued Resource ID: ca47d813-3b19-4aa2-8339-4f933a85963f with Priority: HIGHEST for action security_group_rules [ 725.928507] env[65306]: INFO networking_nsxv3.common.synchronization [req-8bc0865b-2cfd-499a-85a4-121693af7429 req-f14d59e0-6b15-4892-88e4-5d6b5470b8e9 tempest-SecurityGroupsTestJSON-960025904 tempest-SecurityGroupsTestJSON-960025904-project-member] Enqueued Resource ID: ca47d813-3b19-4aa2-8339-4f933a85963f with Priority: HIGHEST for action security_group_members [ 725.928507] env[65306]: INFO networking_nsxv3.common.synchronization [req-8bc0865b-2cfd-499a-85a4-121693af7429 req-f14d59e0-6b15-4892-88e4-5d6b5470b8e9 tempest-SecurityGroupsTestJSON-960025904 tempest-SecurityGroupsTestJSON-960025904-project-member] Enqueued Resource ID: 0ff68b46-78c7-46d5-a67b-1f11d60599cc with Priority: HIGHEST for action port [ 725.928958] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4e234e08-a192-4c7a-badf-3e57629854d7 with Priority: HIGHEST for action security_group_rules [ 725.929328] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ca47d813-3b19-4aa2-8339-4f933a85963f with Priority: HIGHEST for action security_group_rules [ 725.929453] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0ff68b46-78c7-46d5-a67b-1f11d60599cc with Priority: HIGHEST for action port [ 725.929551] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4e234e08-a192-4c7a-badf-3e57629854d7 with Priority: HIGHEST for action security_group_members [ 725.929673] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ca47d813-3b19-4aa2-8339-4f933a85963f with Priority: HIGHEST for action security_group_members [ 725.929955] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4e234e08-a192-4c7a-badf-3e57629854d7 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.930097] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4e234e08-a192-4c7a-badf-3e57629854d7" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.930241] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4e234e08-a192-4c7a-badf-3e57629854d7" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.930373] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4e234e08-a192-4c7a-badf-3e57629854d7" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.930470] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4e234e08-a192-4c7a-badf-3e57629854d7',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 725.932451] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ca47d813-3b19-4aa2-8339-4f933a85963f taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.932451] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ca47d813-3b19-4aa2-8339-4f933a85963f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.932451] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ca47d813-3b19-4aa2-8339-4f933a85963f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.932613] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ca47d813-3b19-4aa2-8339-4f933a85963f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.932613] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ca47d813-3b19-4aa2-8339-4f933a85963f',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 725.934634] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock port-0ff68b46-78c7-46d5-a67b-1f11d60599cc taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.934634] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0ff68b46-78c7-46d5-a67b-1f11d60599cc" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.934634] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0ff68b46-78c7-46d5-a67b-1f11d60599cc" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.934634] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0ff68b46-78c7-46d5-a67b-1f11d60599cc" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.934875] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0ff68b46-78c7-46d5-a67b-1f11d60599cc',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 725.936186] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-4e234e08-a192-4c7a-badf-3e57629854d7 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.936280] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4e234e08-a192-4c7a-badf-3e57629854d7" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.936705] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-ca47d813-3b19-4aa2-8339-4f933a85963f taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.936705] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ca47d813-3b19-4aa2-8339-4f933a85963f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.205789] env[65306]: INFO networking_nsxv3.common.synchronization [req-ce8e857c-9df8-4e89-a13c-934eaf65e49c req-b18bd26e-6d55-4ef0-9d29-ad93dc84e0aa tempest-ServersWithSpecificFlavorTestJSON-1706838422 tempest-ServersWithSpecificFlavorTestJSON-1706838422-project-member] Enqueued Resource ID: ef5de9e7-0c3b-4386-af3c-de134eff75f3 with Priority: HIGHEST for action security_group_members [ 726.206506] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ef5de9e7-0c3b-4386-af3c-de134eff75f3 with Priority: HIGHEST for action security_group_members [ 726.207047] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-ef5de9e7-0c3b-4386-af3c-de134eff75f3 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.207047] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ef5de9e7-0c3b-4386-af3c-de134eff75f3" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.207211] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ef5de9e7-0c3b-4386-af3c-de134eff75f3" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.207419] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ef5de9e7-0c3b-4386-af3c-de134eff75f3" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.207524] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.207629] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.207689] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.207838] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.207924] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.208050] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ef5de9e7-0c3b-4386-af3c-de134eff75f3',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 726.380690] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ca47d813-3b19-4aa2-8339-4f933a85963f',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 726.385230] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4e234e08-a192-4c7a-badf-3e57629854d7',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 726.432670] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-4e234e08-a192-4c7a-badf-3e57629854d7 taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.432809] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4e234e08-a192-4c7a-badf-3e57629854d7" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.435080] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-ca47d813-3b19-4aa2-8339-4f933a85963f taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.435080] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ca47d813-3b19-4aa2-8339-4f933a85963f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.439794] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0ff68b46-78c7-46d5-a67b-1f11d60599cc with status ACTIVE [ 726.440054] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.440177] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.440243] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.440865] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.440865] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.440865] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.441033] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.441033] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.441147] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.441220] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.441394] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.441484] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.441543] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.442421] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.442421] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.442421] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0ff68b46-78c7-46d5-a67b-1f11d60599cc is going to be updated. [ 726.463973] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.464120] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.464120] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.464744] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.464744] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.464744] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0ff68b46-78c7-46d5-a67b-1f11d60599cc" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.543028] env[65306]: INFO networking_nsxv3.common.synchronization [None req-68535c68-df03-4934-92a7-f1b90fa195f9 None None] Enqueued Resource ID: 6a13db25-f540-4c1f-bb9a-8e9048c68b92 with Priority: HIGHEST for action port [ 726.543028] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6a13db25-f540-4c1f-bb9a-8e9048c68b92 with Priority: HIGHEST for action port [ 726.543028] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock port-6a13db25-f540-4c1f-bb9a-8e9048c68b92 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.543028] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6a13db25-f540-4c1f-bb9a-8e9048c68b92" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.543028] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6a13db25-f540-4c1f-bb9a-8e9048c68b92" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.544247] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6a13db25-f540-4c1f-bb9a-8e9048c68b92" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.544818] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6a13db25-f540-4c1f-bb9a-8e9048c68b92',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 726.696022] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock network-35 taken with stack trace [, , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.696022] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "network-35" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.696022] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "network-35" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.696022] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "network-35" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.696255] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.697177] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.697177] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.697177] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.697177] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.697177] env[65306]: DEBUG dogpile.cache.region [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] No value present for key: 'zone-id' {{(pid=65306) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 726.697433] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] NeedRegenerationException {{(pid=65306) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 726.697433] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] no value, waiting for create lock {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 726.697495] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] value creation lock acquired {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 726.697566] env[65306]: DEBUG dogpile.cache.region [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] No value present for key: 'zone-id' {{(pid=65306) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 726.697696] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Calling creation function for not-yet-present value {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 726.697826] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 726.710926] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.711133] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.711264] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.711436] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.711531] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.711729] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.711828] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.711936] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.712170] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.712170] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.713029] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ef5de9e7-0c3b-4386-af3c-de134eff75f3 is going to be updated. [ 726.720324] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 726.720529] env[65306]: DEBUG dogpile.cache.region [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65306) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 726.720640] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Released creation lock {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 726.720764] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "network-35" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.721117] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock port-740274bf-5bfe-48d7-8b3a-e51ca2d5072b taken with stack trace [, , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.721310] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "port-740274bf-5bfe-48d7-8b3a-e51ca2d5072b" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.721430] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "port-740274bf-5bfe-48d7-8b3a-e51ca2d5072b" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.721746] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "port-740274bf-5bfe-48d7-8b3a-e51ca2d5072b" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.721884] env[65306]: DEBUG networking_nsxv3.api.rpc [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('740274bf-5bfe-48d7-8b3a-e51ca2d5072b',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 726.740120] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.740384] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.740384] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.740688] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.740784] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.749785] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ef5de9e7-0c3b-4386-af3c-de134eff75f3 in Status: IN_PROGRESS for 2s [ 726.885403] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ca47d813-3b19-4aa2-8339-4f933a85963f',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 726.887538] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4e234e08-a192-4c7a-badf-3e57629854d7',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 727.047946] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6a13db25-f540-4c1f-bb9a-8e9048c68b92 [ 727.048286] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.048477] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.048525] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.048771] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.048879] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.048976] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6a13db25-f540-4c1f-bb9a-8e9048c68b92 already deleted. [ 727.049075] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6a13db25-f540-4c1f-bb9a-8e9048c68b92" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.224613] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.224782] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.224905] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.225161] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.225577] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.225577] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Segment Port 740274bf-5bfe-48d7-8b3a-e51ca2d5072b not found, creating... [ 727.225786] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.225954] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.226089] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.226348] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.226490] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.226862] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.227571] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.227754] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.228009] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.228155] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.228349] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Resource: SegmentPort with ID: 740274bf-5bfe-48d7-8b3a-e51ca2d5072b is going to be created. [ 727.251634] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.251900] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.251966] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.252240] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.252458] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.252684] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "port-740274bf-5bfe-48d7-8b3a-e51ca2d5072b" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.391776] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.391945] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.392031] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.392248] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.392336] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.392438] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ca47d813-3b19-4aa2-8339-4f933a85963f is going to be created. [ 727.393914] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.394084] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.394163] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.394342] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.394421] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.394521] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4e234e08-a192-4c7a-badf-3e57629854d7 is going to be updated. [ 727.443717] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.443917] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.443917] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.444170] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.444328] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.449646] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.449823] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.450530] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.450530] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.450530] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.457506] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ca47d813-3b19-4aa2-8339-4f933a85963f in Status: UNINITIALIZED for 2s [ 727.462156] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4e234e08-a192-4c7a-badf-3e57629854d7 in Status: IN_PROGRESS for 2s [ 728.145316] env[65306]: INFO networking_nsxv3.common.synchronization [req-ce8e857c-9df8-4e89-a13c-934eaf65e49c req-522b72ea-df54-4601-9655-89cf434f41dd service nova] Enqueued Resource ID: ef5de9e7-0c3b-4386-af3c-de134eff75f3 with Priority: HIGHEST for action security_group_rules [ 728.145316] env[65306]: INFO networking_nsxv3.common.synchronization [req-ce8e857c-9df8-4e89-a13c-934eaf65e49c req-522b72ea-df54-4601-9655-89cf434f41dd service nova] Enqueued Resource ID: ef5de9e7-0c3b-4386-af3c-de134eff75f3 with Priority: HIGHEST for action security_group_members [ 728.146468] env[65306]: INFO networking_nsxv3.common.synchronization [req-ce8e857c-9df8-4e89-a13c-934eaf65e49c req-522b72ea-df54-4601-9655-89cf434f41dd service nova] Enqueued Resource ID: 740274bf-5bfe-48d7-8b3a-e51ca2d5072b with Priority: HIGHEST for action port [ 728.146468] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ef5de9e7-0c3b-4386-af3c-de134eff75f3 with Priority: HIGHEST for action security_group_rules [ 728.146468] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ef5de9e7-0c3b-4386-af3c-de134eff75f3 with Priority: HIGHEST for action security_group_members [ 728.146468] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 740274bf-5bfe-48d7-8b3a-e51ca2d5072b with Priority: HIGHEST for action port [ 728.146739] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ef5de9e7-0c3b-4386-af3c-de134eff75f3 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.146897] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ef5de9e7-0c3b-4386-af3c-de134eff75f3" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.146897] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ef5de9e7-0c3b-4386-af3c-de134eff75f3" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.149187] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ef5de9e7-0c3b-4386-af3c-de134eff75f3" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.149187] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ef5de9e7-0c3b-4386-af3c-de134eff75f3',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 728.149187] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-ef5de9e7-0c3b-4386-af3c-de134eff75f3 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.149187] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ef5de9e7-0c3b-4386-af3c-de134eff75f3" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.149187] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock port-740274bf-5bfe-48d7-8b3a-e51ca2d5072b taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.149187] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-740274bf-5bfe-48d7-8b3a-e51ca2d5072b" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.149187] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-740274bf-5bfe-48d7-8b3a-e51ca2d5072b" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.150217] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-740274bf-5bfe-48d7-8b3a-e51ca2d5072b" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.150310] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('740274bf-5bfe-48d7-8b3a-e51ca2d5072b',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 728.652693] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-ef5de9e7-0c3b-4386-af3c-de134eff75f3 taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.652883] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ef5de9e7-0c3b-4386-af3c-de134eff75f3" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.653873] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 740274bf-5bfe-48d7-8b3a-e51ca2d5072b with status ACTIVE [ 728.653873] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.653873] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.653873] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.653873] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.653873] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.654266] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.654266] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.654266] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.654523] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.654804] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.655022] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.655022] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.655022] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.655192] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.655324] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.655477] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 740274bf-5bfe-48d7-8b3a-e51ca2d5072b is going to be updated. [ 728.691502] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.691502] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.691502] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.691502] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.691502] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.691502] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-740274bf-5bfe-48d7-8b3a-e51ca2d5072b" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.762862] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ef5de9e7-0c3b-4386-af3c-de134eff75f3 in Status: SUCCESS [ 728.763059] env[65306]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ef5de9e7-0c3b-4386-af3c-de134eff75f3 deletion is rescheduled due to dependency. [ 728.763184] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ef5de9e7-0c3b-4386-af3c-de134eff75f3" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.763741] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ef5de9e7-0c3b-4386-af3c-de134eff75f3" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.763741] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ef5de9e7-0c3b-4386-af3c-de134eff75f3" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.763853] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.763991] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.764070] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.764216] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.764285] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.764447] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ef5de9e7-0c3b-4386-af3c-de134eff75f3',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 729.113965] env[65306]: INFO networking_nsxv3.common.synchronization [req-c9906063-eabc-4bbc-b1c4-96650412439d req-97eb98bf-0cfc-41bf-8bf5-40bde7ce932c tempest-SecurityGroupsTestJSON-960025904 tempest-SecurityGroupsTestJSON-960025904-project-member] Enqueued Resource ID: ca47d813-3b19-4aa2-8339-4f933a85963f with Priority: HIGHEST for action security_group_members [ 729.113965] env[65306]: INFO networking_nsxv3.common.synchronization [req-c9906063-eabc-4bbc-b1c4-96650412439d req-97eb98bf-0cfc-41bf-8bf5-40bde7ce932c tempest-SecurityGroupsTestJSON-960025904 tempest-SecurityGroupsTestJSON-960025904-project-member] Enqueued Resource ID: 7f0c403f-7209-472e-8592-d169f66791c9 with Priority: HIGHEST for action security_group_members [ 729.113965] env[65306]: INFO networking_nsxv3.common.synchronization [req-c9906063-eabc-4bbc-b1c4-96650412439d req-97eb98bf-0cfc-41bf-8bf5-40bde7ce932c tempest-SecurityGroupsTestJSON-960025904 tempest-SecurityGroupsTestJSON-960025904-project-member] Enqueued Resource ID: 4e234e08-a192-4c7a-badf-3e57629854d7 with Priority: HIGHEST for action security_group_members [ 729.115175] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ca47d813-3b19-4aa2-8339-4f933a85963f with Priority: HIGHEST for action security_group_members [ 729.115483] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7f0c403f-7209-472e-8592-d169f66791c9 with Priority: HIGHEST for action security_group_members [ 729.115813] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4e234e08-a192-4c7a-badf-3e57629854d7 with Priority: HIGHEST for action security_group_members [ 729.116284] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-ca47d813-3b19-4aa2-8339-4f933a85963f taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.116544] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ca47d813-3b19-4aa2-8339-4f933a85963f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.116893] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-7f0c403f-7209-472e-8592-d169f66791c9 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.117187] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7f0c403f-7209-472e-8592-d169f66791c9" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.117664] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7f0c403f-7209-472e-8592-d169f66791c9" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.118474] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7f0c403f-7209-472e-8592-d169f66791c9" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.118474] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.118474] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.118780] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.120145] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.120145] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.120145] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7f0c403f-7209-472e-8592-d169f66791c9',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 729.120448] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-4e234e08-a192-4c7a-badf-3e57629854d7 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.120535] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4e234e08-a192-4c7a-badf-3e57629854d7" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.211544] env[65306]: INFO networking_nsxv3.common.synchronization [req-c9906063-eabc-4bbc-b1c4-96650412439d req-97eb98bf-0cfc-41bf-8bf5-40bde7ce932c tempest-SecurityGroupsTestJSON-960025904 tempest-SecurityGroupsTestJSON-960025904-project-member] Enqueued Resource ID: 4e234e08-a192-4c7a-badf-3e57629854d7 with Priority: HIGHEST for action security_group_rules [ 729.211813] env[65306]: INFO networking_nsxv3.common.synchronization [req-c9906063-eabc-4bbc-b1c4-96650412439d req-97eb98bf-0cfc-41bf-8bf5-40bde7ce932c tempest-SecurityGroupsTestJSON-960025904 tempest-SecurityGroupsTestJSON-960025904-project-member] Enqueued Resource ID: 4e234e08-a192-4c7a-badf-3e57629854d7 with Priority: HIGHEST for action security_group_members [ 729.211874] env[65306]: INFO networking_nsxv3.common.synchronization [req-c9906063-eabc-4bbc-b1c4-96650412439d req-97eb98bf-0cfc-41bf-8bf5-40bde7ce932c tempest-SecurityGroupsTestJSON-960025904 tempest-SecurityGroupsTestJSON-960025904-project-member] Enqueued Resource ID: 7f0c403f-7209-472e-8592-d169f66791c9 with Priority: HIGHEST for action security_group_rules [ 729.212349] env[65306]: INFO networking_nsxv3.common.synchronization [req-c9906063-eabc-4bbc-b1c4-96650412439d req-97eb98bf-0cfc-41bf-8bf5-40bde7ce932c tempest-SecurityGroupsTestJSON-960025904 tempest-SecurityGroupsTestJSON-960025904-project-member] Enqueued Resource ID: 7f0c403f-7209-472e-8592-d169f66791c9 with Priority: HIGHEST for action security_group_members [ 729.213191] env[65306]: INFO networking_nsxv3.common.synchronization [req-c9906063-eabc-4bbc-b1c4-96650412439d req-97eb98bf-0cfc-41bf-8bf5-40bde7ce932c tempest-SecurityGroupsTestJSON-960025904 tempest-SecurityGroupsTestJSON-960025904-project-member] Enqueued Resource ID: ca47d813-3b19-4aa2-8339-4f933a85963f with Priority: HIGHEST for action security_group_rules [ 729.213445] env[65306]: INFO networking_nsxv3.common.synchronization [req-c9906063-eabc-4bbc-b1c4-96650412439d req-97eb98bf-0cfc-41bf-8bf5-40bde7ce932c tempest-SecurityGroupsTestJSON-960025904 tempest-SecurityGroupsTestJSON-960025904-project-member] Enqueued Resource ID: ca47d813-3b19-4aa2-8339-4f933a85963f with Priority: HIGHEST for action security_group_members [ 729.213672] env[65306]: INFO networking_nsxv3.common.synchronization [req-c9906063-eabc-4bbc-b1c4-96650412439d req-97eb98bf-0cfc-41bf-8bf5-40bde7ce932c tempest-SecurityGroupsTestJSON-960025904 tempest-SecurityGroupsTestJSON-960025904-project-member] Enqueued Resource ID: 0ff68b46-78c7-46d5-a67b-1f11d60599cc with Priority: HIGHEST for action port [ 729.214389] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4e234e08-a192-4c7a-badf-3e57629854d7 with Priority: HIGHEST for action security_group_rules [ 729.214522] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7f0c403f-7209-472e-8592-d169f66791c9 with Priority: HIGHEST for action security_group_rules [ 729.214636] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ca47d813-3b19-4aa2-8339-4f933a85963f with Priority: HIGHEST for action security_group_members [ 729.214728] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0ff68b46-78c7-46d5-a67b-1f11d60599cc with Priority: HIGHEST for action port [ 729.214877] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ca47d813-3b19-4aa2-8339-4f933a85963f with Priority: HIGHEST for action security_group_rules [ 729.214906] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4e234e08-a192-4c7a-badf-3e57629854d7 with Priority: HIGHEST for action security_group_members [ 729.214982] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7f0c403f-7209-472e-8592-d169f66791c9 with Priority: HIGHEST for action security_group_members [ 729.215327] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4e234e08-a192-4c7a-badf-3e57629854d7 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.215405] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4e234e08-a192-4c7a-badf-3e57629854d7" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.216371] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7f0c403f-7209-472e-8592-d169f66791c9 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.216480] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7f0c403f-7209-472e-8592-d169f66791c9" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.216556] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7f0c403f-7209-472e-8592-d169f66791c9" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.220340] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7f0c403f-7209-472e-8592-d169f66791c9" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.220489] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7f0c403f-7209-472e-8592-d169f66791c9',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 729.221723] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-ca47d813-3b19-4aa2-8339-4f933a85963f taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.221876] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ca47d813-3b19-4aa2-8339-4f933a85963f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.222125] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock port-0ff68b46-78c7-46d5-a67b-1f11d60599cc taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.222250] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0ff68b46-78c7-46d5-a67b-1f11d60599cc" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.222344] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0ff68b46-78c7-46d5-a67b-1f11d60599cc" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.222589] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0ff68b46-78c7-46d5-a67b-1f11d60599cc" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.222685] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0ff68b46-78c7-46d5-a67b-1f11d60599cc',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 729.224647] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ca47d813-3b19-4aa2-8339-4f933a85963f taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.224781] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ca47d813-3b19-4aa2-8339-4f933a85963f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.225076] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-4e234e08-a192-4c7a-badf-3e57629854d7 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.225216] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4e234e08-a192-4c7a-badf-3e57629854d7" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.225463] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-7f0c403f-7209-472e-8592-d169f66791c9 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.225632] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7f0c403f-7209-472e-8592-d169f66791c9" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.267774] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ef5de9e7-0c3b-4386-af3c-de134eff75f3',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 729.472021] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ca47d813-3b19-4aa2-8339-4f933a85963f in Status: SUCCESS [ 729.472021] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ca47d813-3b19-4aa2-8339-4f933a85963f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.472021] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ca47d813-3b19-4aa2-8339-4f933a85963f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.472021] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ca47d813-3b19-4aa2-8339-4f933a85963f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.472021] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.472021] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.472021] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.472021] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.472021] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.472021] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ca47d813-3b19-4aa2-8339-4f933a85963f',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 729.474623] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4e234e08-a192-4c7a-badf-3e57629854d7 in Status: SUCCESS [ 729.474964] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4e234e08-a192-4c7a-badf-3e57629854d7" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.476594] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4e234e08-a192-4c7a-badf-3e57629854d7" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.476594] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4e234e08-a192-4c7a-badf-3e57629854d7" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.476594] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.476594] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.476594] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.476594] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.476594] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.476594] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4e234e08-a192-4c7a-badf-3e57629854d7',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 729.622491] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7f0c403f-7209-472e-8592-d169f66791c9',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 729.727123] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0ff68b46-78c7-46d5-a67b-1f11d60599cc with status ACTIVE [ 729.727573] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.727948] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.727948] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.728524] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.728524] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.729053] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.729053] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.729053] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.729370] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.729370] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.729519] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.729597] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.729698] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.729829] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.729909] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.730008] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0ff68b46-78c7-46d5-a67b-1f11d60599cc is going to be updated. [ 729.731283] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-7f0c403f-7209-472e-8592-d169f66791c9 taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.731394] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7f0c403f-7209-472e-8592-d169f66791c9" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.764368] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.764368] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.764368] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.764699] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.764699] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.765083] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0ff68b46-78c7-46d5-a67b-1f11d60599cc" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.769551] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ef5de9e7-0c3b-4386-af3c-de134eff75f3',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 729.942266] env[65306]: INFO networking_nsxv3.common.synchronization [None req-9f3f24c2-8d31-4f88-8988-d2e03cf88e0a None None] Enqueued Resource ID: 45e856ee-4740-4557-8e59-55cd6951266a with Priority: HIGHEST for action port [ 729.942266] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 45e856ee-4740-4557-8e59-55cd6951266a with Priority: HIGHEST for action port [ 729.942698] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock port-45e856ee-4740-4557-8e59-55cd6951266a taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.943047] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-45e856ee-4740-4557-8e59-55cd6951266a" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.943266] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-45e856ee-4740-4557-8e59-55cd6951266a" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.945394] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-45e856ee-4740-4557-8e59-55cd6951266a" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.945394] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('45e856ee-4740-4557-8e59-55cd6951266a',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 729.974132] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ca47d813-3b19-4aa2-8339-4f933a85963f',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 729.980306] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4e234e08-a192-4c7a-badf-3e57629854d7',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 730.124479] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7f0c403f-7209-472e-8592-d169f66791c9',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 730.272473] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.272473] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.273288] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.273288] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.273288] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.273636] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ef5de9e7-0c3b-4386-af3c-de134eff75f3 is going to be updated. [ 730.307551] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.307752] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.307813] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.308174] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.308341] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.318181] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ef5de9e7-0c3b-4386-af3c-de134eff75f3 in Status: IN_PROGRESS for 2s [ 730.446367] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 45e856ee-4740-4557-8e59-55cd6951266a [ 730.447785] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.447785] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.447785] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.447785] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.447785] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.447785] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:45e856ee-4740-4557-8e59-55cd6951266a already deleted. [ 730.447785] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-45e856ee-4740-4557-8e59-55cd6951266a" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.478183] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ca47d813-3b19-4aa2-8339-4f933a85963f',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 730.481308] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4e234e08-a192-4c7a-badf-3e57629854d7',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 730.631193] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.631380] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.631380] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.632124] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.632124] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.632124] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7f0c403f-7209-472e-8592-d169f66791c9 is going to be created. [ 730.666606] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.666785] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.666816] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.667897] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.667897] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.681913] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7f0c403f-7209-472e-8592-d169f66791c9 in Status: UNINITIALIZED for 2s [ 730.809810] env[65306]: INFO networking_nsxv3.common.synchronization [None req-1213536a-d532-4cdc-bfe5-bd0aca6936dc None None] Enqueued Resource ID: 71f5c87c-9968-4e81-93a3-fe6a5f4ed58e with Priority: HIGHEST for action port [ 730.810472] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 71f5c87c-9968-4e81-93a3-fe6a5f4ed58e with Priority: HIGHEST for action port [ 730.810811] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock port-71f5c87c-9968-4e81-93a3-fe6a5f4ed58e taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.810949] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-71f5c87c-9968-4e81-93a3-fe6a5f4ed58e" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.811070] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-71f5c87c-9968-4e81-93a3-fe6a5f4ed58e" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.811341] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-71f5c87c-9968-4e81-93a3-fe6a5f4ed58e" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.811428] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('71f5c87c-9968-4e81-93a3-fe6a5f4ed58e',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 730.981250] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.981250] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.981250] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.981487] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.981487] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.981548] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ca47d813-3b19-4aa2-8339-4f933a85963f is going to be updated. [ 730.986187] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.986368] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.986499] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.986619] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.986785] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.986948] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4e234e08-a192-4c7a-badf-3e57629854d7 is going to be updated. [ 731.018348] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.018510] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.018584] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.018828] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.018977] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.020858] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.020986] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.021202] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.021420] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.021587] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.034172] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4e234e08-a192-4c7a-badf-3e57629854d7 in Status: IN_PROGRESS for 2s [ 731.034172] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ca47d813-3b19-4aa2-8339-4f933a85963f in Status: IN_PROGRESS for 2s [ 731.313865] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 71f5c87c-9968-4e81-93a3-fe6a5f4ed58e [ 731.313865] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.313865] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.313865] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.313865] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.314309] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.314309] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:71f5c87c-9968-4e81-93a3-fe6a5f4ed58e already deleted. [ 731.314309] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-71f5c87c-9968-4e81-93a3-fe6a5f4ed58e" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.337853] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ef5de9e7-0c3b-4386-af3c-de134eff75f3 in Status: SUCCESS [ 732.338125] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ef5de9e7-0c3b-4386-af3c-de134eff75f3" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.338434] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ef5de9e7-0c3b-4386-af3c-de134eff75f3" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.338559] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ef5de9e7-0c3b-4386-af3c-de134eff75f3" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.338662] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.338782] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.338844] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.339016] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.339152] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.339205] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ef5de9e7-0c3b-4386-af3c-de134eff75f3" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.339283] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ef5de9e7-0c3b-4386-af3c-de134eff75f3',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 732.693171] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7f0c403f-7209-472e-8592-d169f66791c9 in Status: SUCCESS [ 732.693463] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7f0c403f-7209-472e-8592-d169f66791c9" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.693635] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7f0c403f-7209-472e-8592-d169f66791c9" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.693916] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7f0c403f-7209-472e-8592-d169f66791c9" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.695067] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.695067] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.695067] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.695067] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.695067] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.695067] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7f0c403f-7209-472e-8592-d169f66791c9',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 732.839278] env[65306]: INFO networking_nsxv3.common.synchronization [None req-852db76d-3f8f-4dd8-9a4e-bee9bfbaf87d None None] Enqueued Resource ID: e7d05b5b-202b-4a16-b2e8-c9f2a5222db6 with Priority: HIGHEST for action port [ 732.839912] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e7d05b5b-202b-4a16-b2e8-c9f2a5222db6 with Priority: HIGHEST for action port [ 732.840164] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock port-e7d05b5b-202b-4a16-b2e8-c9f2a5222db6 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.840349] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e7d05b5b-202b-4a16-b2e8-c9f2a5222db6" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.840403] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e7d05b5b-202b-4a16-b2e8-c9f2a5222db6" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.840626] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e7d05b5b-202b-4a16-b2e8-c9f2a5222db6" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.840927] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e7d05b5b-202b-4a16-b2e8-c9f2a5222db6',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 732.841533] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ef5de9e7-0c3b-4386-af3c-de134eff75f3',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 733.046788] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ca47d813-3b19-4aa2-8339-4f933a85963f in Status: SUCCESS [ 733.047045] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ca47d813-3b19-4aa2-8339-4f933a85963f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.047224] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ca47d813-3b19-4aa2-8339-4f933a85963f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.047906] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ca47d813-3b19-4aa2-8339-4f933a85963f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.047906] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.047906] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.047906] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.048137] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.048137] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.048206] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ca47d813-3b19-4aa2-8339-4f933a85963f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.048248] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ca47d813-3b19-4aa2-8339-4f933a85963f',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 733.051536] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4e234e08-a192-4c7a-badf-3e57629854d7 in Status: SUCCESS [ 733.051536] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4e234e08-a192-4c7a-badf-3e57629854d7" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.051536] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ca47d813-3b19-4aa2-8339-4f933a85963f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.051536] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ca47d813-3b19-4aa2-8339-4f933a85963f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.051847] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.052521] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.052627] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.052793] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.052871] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.053153] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ca47d813-3b19-4aa2-8339-4f933a85963f',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 733.055431] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4e234e08-a192-4c7a-badf-3e57629854d7" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.055431] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4e234e08-a192-4c7a-badf-3e57629854d7" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.055431] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.055431] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.055431] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.055431] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.055431] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.055790] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4e234e08-a192-4c7a-badf-3e57629854d7" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.055790] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4e234e08-a192-4c7a-badf-3e57629854d7',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 733.056799] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4e234e08-a192-4c7a-badf-3e57629854d7" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.056865] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4e234e08-a192-4c7a-badf-3e57629854d7" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.057431] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.057431] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.057431] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.057976] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.057976] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.057976] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4e234e08-a192-4c7a-badf-3e57629854d7',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 733.198579] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7f0c403f-7209-472e-8592-d169f66791c9',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 733.343432] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e7d05b5b-202b-4a16-b2e8-c9f2a5222db6 [ 733.343710] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.343710] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.343823] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.343948] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.344055] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.344154] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e7d05b5b-202b-4a16-b2e8-c9f2a5222db6 already deleted. [ 733.344239] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e7d05b5b-202b-4a16-b2e8-c9f2a5222db6" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.344434] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ef5de9e7-0c3b-4386-af3c-de134eff75f3: rpc.has_security_group_logging(os_id): False [ 733.365972] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.366077] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.366146] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.366359] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.366448] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.366692] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.366789] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.366852] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.367000] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.367085] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.367170] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ef5de9e7-0c3b-4386-af3c-de134eff75f3 is going to be updated. [ 733.442180] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.442180] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.442180] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.442497] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.442497] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.460281] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ef5de9e7-0c3b-4386-af3c-de134eff75f3 in Status: IN_PROGRESS for 2s [ 733.558086] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ca47d813-3b19-4aa2-8339-4f933a85963f',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 733.559107] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ca47d813-3b19-4aa2-8339-4f933a85963f',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 733.560147] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-4e234e08-a192-4c7a-badf-3e57629854d7 taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.560298] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4e234e08-a192-4c7a-badf-3e57629854d7" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.560707] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4e234e08-a192-4c7a-badf-3e57629854d7',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 733.701414] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7f0c403f-7209-472e-8592-d169f66791c9',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 734.063375] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ca47d813-3b19-4aa2-8339-4f933a85963f',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 734.065930] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4e234e08-a192-4c7a-badf-3e57629854d7',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 734.066544] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ca47d813-3b19-4aa2-8339-4f933a85963f: rpc.has_security_group_logging(os_id): False [ 734.096316] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.096316] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.096316] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.096316] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.096316] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.096316] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.096316] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.096316] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.096316] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.096316] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.096316] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ca47d813-3b19-4aa2-8339-4f933a85963f is going to be created. [ 734.123799] env[65306]: INFO networking_nsxv3.common.synchronization [None req-a95bccf3-cdc7-4ca1-b548-18a9ada7b3e7 None None] Enqueued Resource ID: f937fc8e-c628-41e5-8802-85411aa023ea with Priority: HIGHEST for action port [ 734.123799] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f937fc8e-c628-41e5-8802-85411aa023ea with Priority: HIGHEST for action port [ 734.126035] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock port-f937fc8e-c628-41e5-8802-85411aa023ea taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.126415] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f937fc8e-c628-41e5-8802-85411aa023ea" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.127107] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f937fc8e-c628-41e5-8802-85411aa023ea" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.127627] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f937fc8e-c628-41e5-8802-85411aa023ea" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.128957] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f937fc8e-c628-41e5-8802-85411aa023ea',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 734.162898] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.163239] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.163350] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.163603] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.163798] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.187838] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ca47d813-3b19-4aa2-8339-4f933a85963f in Status: IN_PROGRESS for 2s [ 734.204735] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.205039] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.205039] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.205296] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.205372] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.205476] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7f0c403f-7209-472e-8592-d169f66791c9 is going to be updated. [ 734.240947] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.241145] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.241215] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.241432] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.241589] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.270863] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7f0c403f-7209-472e-8592-d169f66791c9 in Status: IN_PROGRESS for 2s [ 734.573965] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.574412] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.574527] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.574838] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.574940] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.575163] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ca47d813-3b19-4aa2-8339-4f933a85963f is going to be updated. [ 734.576637] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.576752] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.576820] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.577233] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.577330] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.577645] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4e234e08-a192-4c7a-badf-3e57629854d7 is going to be updated. [ 734.617344] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.617344] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.617344] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.617344] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.617620] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.625026] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.625026] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.625026] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.625026] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.625026] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.639438] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f937fc8e-c628-41e5-8802-85411aa023ea [ 734.641450] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.641450] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.641450] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.641450] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.641450] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.641450] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f937fc8e-c628-41e5-8802-85411aa023ea already deleted. [ 734.641450] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f937fc8e-c628-41e5-8802-85411aa023ea" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.645850] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4e234e08-a192-4c7a-badf-3e57629854d7 in Status: IN_PROGRESS for 2s [ 734.646494] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ca47d813-3b19-4aa2-8339-4f933a85963f in Status: IN_PROGRESS for 2s [ 735.486024] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ef5de9e7-0c3b-4386-af3c-de134eff75f3 in Status: SUCCESS [ 735.486024] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ef5de9e7-0c3b-4386-af3c-de134eff75f3" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.207784] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ca47d813-3b19-4aa2-8339-4f933a85963f in Status: SUCCESS [ 736.207784] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ca47d813-3b19-4aa2-8339-4f933a85963f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.207784] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ca47d813-3b19-4aa2-8339-4f933a85963f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.207784] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ca47d813-3b19-4aa2-8339-4f933a85963f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.207784] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ca47d813-3b19-4aa2-8339-4f933a85963f',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 736.282222] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7f0c403f-7209-472e-8592-d169f66791c9 in Status: SUCCESS [ 736.282470] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7f0c403f-7209-472e-8592-d169f66791c9" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.282646] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7f0c403f-7209-472e-8592-d169f66791c9" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.282916] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7f0c403f-7209-472e-8592-d169f66791c9" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.283218] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.283377] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.283480] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.283717] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.283813] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.283931] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7f0c403f-7209-472e-8592-d169f66791c9" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.284066] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7f0c403f-7209-472e-8592-d169f66791c9',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 736.659258] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ca47d813-3b19-4aa2-8339-4f933a85963f in Status: SUCCESS [ 736.659556] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ca47d813-3b19-4aa2-8339-4f933a85963f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.660708] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4e234e08-a192-4c7a-badf-3e57629854d7 in Status: SUCCESS [ 736.661050] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4e234e08-a192-4c7a-badf-3e57629854d7" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.661276] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ca47d813-3b19-4aa2-8339-4f933a85963f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.661545] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ca47d813-3b19-4aa2-8339-4f933a85963f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.661803] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.661946] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.662057] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.662280] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.662389] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.662514] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ca47d813-3b19-4aa2-8339-4f933a85963f',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 736.663712] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4e234e08-a192-4c7a-badf-3e57629854d7" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.663958] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4e234e08-a192-4c7a-badf-3e57629854d7" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.664198] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.664347] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.664444] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.664656] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.664774] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.664897] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4e234e08-a192-4c7a-badf-3e57629854d7',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 736.712049] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-ca47d813-3b19-4aa2-8339-4f933a85963f taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.712869] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ca47d813-3b19-4aa2-8339-4f933a85963f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.758446] env[65306]: INFO networking_nsxv3.common.synchronization [None req-aaf736f7-a0fe-4579-aa5b-d193b3e55949 None None] Enqueued Resource ID: 3e4b3ca0-3930-45e1-a99f-7ddef3b7c82c with Priority: HIGHEST for action port [ 736.758446] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3e4b3ca0-3930-45e1-a99f-7ddef3b7c82c with Priority: HIGHEST for action port [ 736.758446] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock port-3e4b3ca0-3930-45e1-a99f-7ddef3b7c82c taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.759216] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3e4b3ca0-3930-45e1-a99f-7ddef3b7c82c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.759798] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3e4b3ca0-3930-45e1-a99f-7ddef3b7c82c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.760295] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3e4b3ca0-3930-45e1-a99f-7ddef3b7c82c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.762836] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3e4b3ca0-3930-45e1-a99f-7ddef3b7c82c',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 736.787370] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7f0c403f-7209-472e-8592-d169f66791c9',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 737.167501] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ca47d813-3b19-4aa2-8339-4f933a85963f',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 737.168438] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4e234e08-a192-4c7a-badf-3e57629854d7',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 737.267182] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3e4b3ca0-3930-45e1-a99f-7ddef3b7c82c [ 737.267664] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.267910] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.268054] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.268808] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.268808] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.268808] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3e4b3ca0-3930-45e1-a99f-7ddef3b7c82c already deleted. [ 737.268808] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3e4b3ca0-3930-45e1-a99f-7ddef3b7c82c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.293676] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7f0c403f-7209-472e-8592-d169f66791c9: rpc.has_security_group_logging(os_id): False [ 737.317046] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.317137] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.317222] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.317413] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.317512] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.317807] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.317940] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.319387] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.319387] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.319387] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.319387] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7f0c403f-7209-472e-8592-d169f66791c9 is going to be created. [ 737.392964] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.394672] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.394765] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.395383] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.397468] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.411185] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7f0c403f-7209-472e-8592-d169f66791c9 in Status: IN_PROGRESS for 2s [ 737.579289] env[65306]: INFO networking_nsxv3.common.synchronization [None req-05b5cfd9-d6d8-434e-a4b0-0b39f53997e9 None None] Enqueued Resource ID: 971a7060-fef3-4363-b77d-7254bbe76493 with Priority: HIGHEST for action port [ 737.580304] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 971a7060-fef3-4363-b77d-7254bbe76493 with Priority: HIGHEST for action port [ 737.581954] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock port-971a7060-fef3-4363-b77d-7254bbe76493 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.581954] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-971a7060-fef3-4363-b77d-7254bbe76493" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.581954] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-971a7060-fef3-4363-b77d-7254bbe76493" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.581954] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-971a7060-fef3-4363-b77d-7254bbe76493" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.581954] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('971a7060-fef3-4363-b77d-7254bbe76493',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 737.673200] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ca47d813-3b19-4aa2-8339-4f933a85963f',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 737.673200] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4e234e08-a192-4c7a-badf-3e57629854d7',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 738.086515] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 971a7060-fef3-4363-b77d-7254bbe76493 [ 738.086649] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.086792] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.086856] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.087087] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.087181] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.087276] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:971a7060-fef3-4363-b77d-7254bbe76493 already deleted. [ 738.087355] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-971a7060-fef3-4363-b77d-7254bbe76493" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.176301] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.176301] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.176301] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.176301] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.176301] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.176301] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4e234e08-a192-4c7a-badf-3e57629854d7 is going to be updated. [ 738.177603] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.177764] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.177870] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.178098] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.178308] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.178365] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ca47d813-3b19-4aa2-8339-4f933a85963f is going to be updated. [ 738.211139] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.211139] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.211139] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.211139] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.211139] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.212055] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.212392] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.212569] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.212834] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.213082] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.224888] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4e234e08-a192-4c7a-badf-3e57629854d7 in Status: IN_PROGRESS for 2s [ 738.225949] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ca47d813-3b19-4aa2-8339-4f933a85963f in Status: IN_PROGRESS for 2s [ 739.315971] env[65306]: INFO networking_nsxv3.common.synchronization [req-4f0b49c5-0199-43fa-893f-40e0cdf50f37 req-2ce68fcd-dc67-42f5-9c95-4f2d8af74c50 tempest-AttachInterfacesUnderV243Test-82564794 tempest-AttachInterfacesUnderV243Test-82564794-project-member] Enqueued Resource ID: 30524546-2ed3-474c-bf2b-fc6aff50dfec with Priority: HIGHEST for action security_group_members [ 739.318661] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 30524546-2ed3-474c-bf2b-fc6aff50dfec with Priority: HIGHEST for action security_group_members [ 739.320190] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-30524546-2ed3-474c-bf2b-fc6aff50dfec taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.322181] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-30524546-2ed3-474c-bf2b-fc6aff50dfec" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.322181] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-30524546-2ed3-474c-bf2b-fc6aff50dfec" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.322181] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-30524546-2ed3-474c-bf2b-fc6aff50dfec" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.322181] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.322181] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.322181] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.322181] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.322181] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.322861] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('30524546-2ed3-474c-bf2b-fc6aff50dfec',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 739.353404] env[65306]: INFO networking_nsxv3.common.synchronization [req-4f0b49c5-0199-43fa-893f-40e0cdf50f37 req-2ce68fcd-dc67-42f5-9c95-4f2d8af74c50 tempest-AttachInterfacesUnderV243Test-82564794 tempest-AttachInterfacesUnderV243Test-82564794-project-member] Enqueued Resource ID: 30524546-2ed3-474c-bf2b-fc6aff50dfec with Priority: HIGHEST for action security_group_rules [ 739.353684] env[65306]: INFO networking_nsxv3.common.synchronization [req-4f0b49c5-0199-43fa-893f-40e0cdf50f37 req-2ce68fcd-dc67-42f5-9c95-4f2d8af74c50 tempest-AttachInterfacesUnderV243Test-82564794 tempest-AttachInterfacesUnderV243Test-82564794-project-member] Enqueued Resource ID: 30524546-2ed3-474c-bf2b-fc6aff50dfec with Priority: HIGHEST for action security_group_members [ 739.353836] env[65306]: INFO networking_nsxv3.common.synchronization [req-4f0b49c5-0199-43fa-893f-40e0cdf50f37 req-2ce68fcd-dc67-42f5-9c95-4f2d8af74c50 tempest-AttachInterfacesUnderV243Test-82564794 tempest-AttachInterfacesUnderV243Test-82564794-project-member] Enqueued Resource ID: c9f5e340-cd10-4011-b7e7-487fee143966 with Priority: HIGHEST for action port [ 739.356080] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 30524546-2ed3-474c-bf2b-fc6aff50dfec with Priority: HIGHEST for action security_group_rules [ 739.356080] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 30524546-2ed3-474c-bf2b-fc6aff50dfec with Priority: HIGHEST for action security_group_members [ 739.356080] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c9f5e340-cd10-4011-b7e7-487fee143966 with Priority: HIGHEST for action port [ 739.356080] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock rules-30524546-2ed3-474c-bf2b-fc6aff50dfec taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.356467] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-30524546-2ed3-474c-bf2b-fc6aff50dfec" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.356595] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-30524546-2ed3-474c-bf2b-fc6aff50dfec" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.356773] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-30524546-2ed3-474c-bf2b-fc6aff50dfec" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.356863] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('30524546-2ed3-474c-bf2b-fc6aff50dfec',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 739.358812] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-30524546-2ed3-474c-bf2b-fc6aff50dfec taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.358967] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-30524546-2ed3-474c-bf2b-fc6aff50dfec" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.359278] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock port-c9f5e340-cd10-4011-b7e7-487fee143966 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.359398] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c9f5e340-cd10-4011-b7e7-487fee143966" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.359469] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c9f5e340-cd10-4011-b7e7-487fee143966" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.359672] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c9f5e340-cd10-4011-b7e7-487fee143966" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.359860] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c9f5e340-cd10-4011-b7e7-487fee143966',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 739.436222] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7f0c403f-7209-472e-8592-d169f66791c9 in Status: SUCCESS [ 739.436222] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7f0c403f-7209-472e-8592-d169f66791c9" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.825932] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('30524546-2ed3-474c-bf2b-fc6aff50dfec',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 739.863037] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-30524546-2ed3-474c-bf2b-fc6aff50dfec taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.863190] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-30524546-2ed3-474c-bf2b-fc6aff50dfec" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.863682] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c9f5e340-cd10-4011-b7e7-487fee143966 with status ACTIVE [ 739.863879] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.864058] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.864116] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.864341] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.864440] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.864719] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.864719] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.864957] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.864957] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.865143] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.865254] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.865379] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.865447] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.869024] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.869024] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.869024] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c9f5e340-cd10-4011-b7e7-487fee143966 is going to be updated. [ 739.889703] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.889849] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.889904] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.890403] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.890403] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.890518] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c9f5e340-cd10-4011-b7e7-487fee143966" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.243615] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4e234e08-a192-4c7a-badf-3e57629854d7 in Status: IN_PROGRESS for 4s [ 740.245835] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ca47d813-3b19-4aa2-8339-4f933a85963f in Status: IN_PROGRESS for 4s [ 740.332797] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('30524546-2ed3-474c-bf2b-fc6aff50dfec',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 740.610070] env[65306]: INFO networking_nsxv3.common.synchronization [None req-b8e02465-0c9c-4966-a310-01035f082965 None None] Enqueued Resource ID: 1a9dc3ad-948e-45d1-abc2-f1c0863d76eb with Priority: HIGHEST for action port [ 740.611733] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1a9dc3ad-948e-45d1-abc2-f1c0863d76eb with Priority: HIGHEST for action port [ 740.614546] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock port-1a9dc3ad-948e-45d1-abc2-f1c0863d76eb taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.614811] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1a9dc3ad-948e-45d1-abc2-f1c0863d76eb" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.614811] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1a9dc3ad-948e-45d1-abc2-f1c0863d76eb" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.615053] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1a9dc3ad-948e-45d1-abc2-f1c0863d76eb" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.615142] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1a9dc3ad-948e-45d1-abc2-f1c0863d76eb',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 740.837596] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.837887] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.838031] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.838338] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.838452] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.838555] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 30524546-2ed3-474c-bf2b-fc6aff50dfec is going to be updated. [ 740.886757] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.886921] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.886921] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.887150] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.887322] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.899530] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 30524546-2ed3-474c-bf2b-fc6aff50dfec in Status: IN_PROGRESS for 2s [ 741.121470] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1a9dc3ad-948e-45d1-abc2-f1c0863d76eb [ 741.121739] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.122023] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.122727] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.122727] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.122727] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.122727] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1a9dc3ad-948e-45d1-abc2-f1c0863d76eb already deleted. [ 741.122727] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1a9dc3ad-948e-45d1-abc2-f1c0863d76eb" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.436787] env[65306]: INFO networking_nsxv3.common.synchronization [req-76b6ddab-6e40-4f0f-8925-4cf98ff935ce req-f7ee212e-5571-4a6e-92e3-0928f085ee54 tempest-SecurityGroupRulesNegativeTestJSON-874329279 tempest-SecurityGroupRulesNegativeTestJSON-874329279-project-member] Enqueued Resource ID: 369a26ad-1cc5-4a25-9feb-56c8a1101763 with Priority: HIGHEST for action security_group_rules [ 741.437670] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 369a26ad-1cc5-4a25-9feb-56c8a1101763 with Priority: HIGHEST for action security_group_rules [ 741.437765] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock rules-369a26ad-1cc5-4a25-9feb-56c8a1101763 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.437849] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-369a26ad-1cc5-4a25-9feb-56c8a1101763" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.437884] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-369a26ad-1cc5-4a25-9feb-56c8a1101763" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.438313] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-369a26ad-1cc5-4a25-9feb-56c8a1101763" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.438383] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('369a26ad-1cc5-4a25-9feb-56c8a1101763',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 741.968910] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.969154] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.969216] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.969467] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.969562] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.969657] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 369a26ad-1cc5-4a25-9feb-56c8a1101763 already deleted. [ 741.969764] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-369a26ad-1cc5-4a25-9feb-56c8a1101763" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.258405] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ca47d813-3b19-4aa2-8339-4f933a85963f in Status: SUCCESS [ 742.258660] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ca47d813-3b19-4aa2-8339-4f933a85963f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.259439] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4e234e08-a192-4c7a-badf-3e57629854d7 in Status: SUCCESS [ 742.259806] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4e234e08-a192-4c7a-badf-3e57629854d7" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.259891] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ca47d813-3b19-4aa2-8339-4f933a85963f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.260150] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ca47d813-3b19-4aa2-8339-4f933a85963f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.260357] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.260491] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.260548] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.260732] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.260928] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.261247] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ca47d813-3b19-4aa2-8339-4f933a85963f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.261247] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ca47d813-3b19-4aa2-8339-4f933a85963f',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 742.262223] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4e234e08-a192-4c7a-badf-3e57629854d7" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.262405] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4e234e08-a192-4c7a-badf-3e57629854d7" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.262610] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.262741] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.262780] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.262948] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.263030] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.263156] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4e234e08-a192-4c7a-badf-3e57629854d7" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.263349] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-4e234e08-a192-4c7a-badf-3e57629854d7 taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.263441] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4e234e08-a192-4c7a-badf-3e57629854d7" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.263511] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4e234e08-a192-4c7a-badf-3e57629854d7" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.263677] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4e234e08-a192-4c7a-badf-3e57629854d7" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.263820] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.263959] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.264032] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.264182] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.264273] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.264355] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4e234e08-a192-4c7a-badf-3e57629854d7" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.264445] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4e234e08-a192-4c7a-badf-3e57629854d7',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 742.766661] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ca47d813-3b19-4aa2-8339-4f933a85963f',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 742.768053] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4e234e08-a192-4c7a-badf-3e57629854d7: rpc.has_security_group_logging(os_id): False [ 742.791747] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.795021] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.795021] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.795021] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.795021] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.795021] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.795021] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.795021] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.795021] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.795021] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.795021] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.795021] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.795021] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.795021] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.795021] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.795601] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.795601] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.795601] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.795601] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.795601] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.796027] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4e234e08-a192-4c7a-badf-3e57629854d7 is going to be updated. [ 742.864629] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.864878] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.864878] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.864955] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.865146] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.882127] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4e234e08-a192-4c7a-badf-3e57629854d7 in Status: IN_PROGRESS for 2s [ 742.910572] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 30524546-2ed3-474c-bf2b-fc6aff50dfec in Status: SUCCESS [ 742.910801] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-30524546-2ed3-474c-bf2b-fc6aff50dfec" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.911023] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-30524546-2ed3-474c-bf2b-fc6aff50dfec" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.911622] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-30524546-2ed3-474c-bf2b-fc6aff50dfec" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.911851] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.912015] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.912116] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.912340] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.912472] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.912614] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('30524546-2ed3-474c-bf2b-fc6aff50dfec',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 743.271061] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ca47d813-3b19-4aa2-8339-4f933a85963f: rpc.has_security_group_logging(os_id): False [ 743.293076] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.293257] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.293295] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.293764] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.293764] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.293982] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.294054] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.294130] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.294296] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.294393] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.294473] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ca47d813-3b19-4aa2-8339-4f933a85963f is going to be updated. [ 743.360566] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.360831] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.360831] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.361265] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.361265] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.377869] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ca47d813-3b19-4aa2-8339-4f933a85963f in Status: IN_PROGRESS for 2s [ 743.416460] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('30524546-2ed3-474c-bf2b-fc6aff50dfec',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 743.920261] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('30524546-2ed3-474c-bf2b-fc6aff50dfec',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 744.224966] env[65306]: INFO networking_nsxv3.common.synchronization [req-fdf6fbfa-0237-4afe-901e-00c817d10a08 req-46d84f6c-1d8b-46ae-a5bd-fcf1da75afeb tempest-InstanceActionsNegativeTestJSON-887815147 tempest-InstanceActionsNegativeTestJSON-887815147-project-member] Enqueued Resource ID: 934be6c8-f61f-4a11-9b02-e48c8e4ae509 with Priority: HIGHEST for action security_group_members [ 744.226038] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 934be6c8-f61f-4a11-9b02-e48c8e4ae509 with Priority: HIGHEST for action security_group_members [ 744.227262] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-934be6c8-f61f-4a11-9b02-e48c8e4ae509 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.227262] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-934be6c8-f61f-4a11-9b02-e48c8e4ae509" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.227262] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-934be6c8-f61f-4a11-9b02-e48c8e4ae509" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.229041] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-934be6c8-f61f-4a11-9b02-e48c8e4ae509" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.229041] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.229041] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.229041] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.229380] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.229499] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.229653] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('934be6c8-f61f-4a11-9b02-e48c8e4ae509',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 744.424080] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.424080] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.424080] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.424936] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.425589] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.425589] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 30524546-2ed3-474c-bf2b-fc6aff50dfec is going to be updated. [ 744.461319] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.461603] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.461766] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.462135] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.462647] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.473147] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 30524546-2ed3-474c-bf2b-fc6aff50dfec in Status: IN_PROGRESS for 2s [ 744.595706] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock network-135 taken with stack trace [, , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.595706] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "network-135" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.595706] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "network-135" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.596705] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "network-135" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.596705] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.596705] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.596705] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.597013] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.597114] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.597326] env[65306]: DEBUG dogpile.cache.region [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] No value present for key: 'zone-id' {{(pid=65306) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 744.597440] env[65306]: DEBUG dogpile.lock [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] NeedRegenerationException {{(pid=65306) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 744.598035] env[65306]: DEBUG dogpile.lock [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] no value, waiting for create lock {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 744.598035] env[65306]: DEBUG dogpile.lock [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] value creation lock acquired {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 744.598035] env[65306]: DEBUG dogpile.cache.region [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] No value present for key: 'zone-id' {{(pid=65306) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 744.598035] env[65306]: DEBUG dogpile.lock [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Calling creation function for not-yet-present value {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 744.598035] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 744.619928] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 744.619928] env[65306]: DEBUG dogpile.cache.region [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65306) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 744.620090] env[65306]: DEBUG dogpile.lock [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Released creation lock {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 744.620310] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "network-135" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.620697] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock port-a22fbe34-063b-45e4-9143-abef26a14d30 taken with stack trace [, , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.620940] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "port-a22fbe34-063b-45e4-9143-abef26a14d30" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.621107] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "port-a22fbe34-063b-45e4-9143-abef26a14d30" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.621484] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "port-a22fbe34-063b-45e4-9143-abef26a14d30" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.621680] env[65306]: DEBUG networking_nsxv3.api.rpc [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a22fbe34-063b-45e4-9143-abef26a14d30',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 744.722624] env[65306]: INFO networking_nsxv3.common.synchronization [None req-7149a7de-b503-47dc-862e-db1d1b715492 None None] Enqueued Resource ID: 5618bf9b-36a7-42ae-a482-380fac6ed59c with Priority: HIGHEST for action port [ 744.722892] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5618bf9b-36a7-42ae-a482-380fac6ed59c with Priority: HIGHEST for action port [ 744.723485] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock port-5618bf9b-36a7-42ae-a482-380fac6ed59c taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.723615] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5618bf9b-36a7-42ae-a482-380fac6ed59c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.723682] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5618bf9b-36a7-42ae-a482-380fac6ed59c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.723998] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5618bf9b-36a7-42ae-a482-380fac6ed59c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.724092] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5618bf9b-36a7-42ae-a482-380fac6ed59c',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 744.737773] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.738030] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.738030] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.738247] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.738323] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.738519] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.738618] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.738982] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.738982] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.738982] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.739128] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 934be6c8-f61f-4a11-9b02-e48c8e4ae509 already deleted. [ 744.739128] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-934be6c8-f61f-4a11-9b02-e48c8e4ae509" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.899347] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4e234e08-a192-4c7a-badf-3e57629854d7 in Status: SUCCESS [ 744.899347] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4e234e08-a192-4c7a-badf-3e57629854d7" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.899347] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4e234e08-a192-4c7a-badf-3e57629854d7" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.899347] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4e234e08-a192-4c7a-badf-3e57629854d7" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.899347] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4e234e08-a192-4c7a-badf-3e57629854d7',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 745.124206] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.124675] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.124675] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.124878] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.124878] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.125049] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Segment Port a22fbe34-063b-45e4-9143-abef26a14d30 not found, creating... [ 745.125324] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.125459] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.125572] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.125807] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.125946] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.126222] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.126353] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.126432] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.126633] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.126762] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.126898] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Resource: SegmentPort with ID: a22fbe34-063b-45e4-9143-abef26a14d30 is going to be created. [ 745.150018] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.150018] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.150018] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.150018] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.150018] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.150018] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "port-a22fbe34-063b-45e4-9143-abef26a14d30" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.226917] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5618bf9b-36a7-42ae-a482-380fac6ed59c [ 745.227222] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.227381] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.227472] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.227716] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.227831] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.227943] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5618bf9b-36a7-42ae-a482-380fac6ed59c already deleted. [ 745.228060] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5618bf9b-36a7-42ae-a482-380fac6ed59c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.393962] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ca47d813-3b19-4aa2-8339-4f933a85963f in Status: SUCCESS [ 745.394926] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ca47d813-3b19-4aa2-8339-4f933a85963f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.401805] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-4e234e08-a192-4c7a-badf-3e57629854d7 taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.401966] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4e234e08-a192-4c7a-badf-3e57629854d7" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.402021] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4e234e08-a192-4c7a-badf-3e57629854d7" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.402252] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4e234e08-a192-4c7a-badf-3e57629854d7" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.402424] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.402527] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.402581] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.402730] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.402814] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.402904] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4e234e08-a192-4c7a-badf-3e57629854d7" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.402992] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4e234e08-a192-4c7a-badf-3e57629854d7',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 745.891192] env[65306]: INFO networking_nsxv3.common.synchronization [req-fdf6fbfa-0237-4afe-901e-00c817d10a08 req-76256c4a-7993-4b1e-b844-0e1694d94f0d service nova] Enqueued Resource ID: 934be6c8-f61f-4a11-9b02-e48c8e4ae509 with Priority: HIGHEST for action security_group_rules [ 745.891192] env[65306]: INFO networking_nsxv3.common.synchronization [req-fdf6fbfa-0237-4afe-901e-00c817d10a08 req-76256c4a-7993-4b1e-b844-0e1694d94f0d service nova] Enqueued Resource ID: 934be6c8-f61f-4a11-9b02-e48c8e4ae509 with Priority: HIGHEST for action security_group_members [ 745.891192] env[65306]: INFO networking_nsxv3.common.synchronization [req-fdf6fbfa-0237-4afe-901e-00c817d10a08 req-76256c4a-7993-4b1e-b844-0e1694d94f0d service nova] Enqueued Resource ID: a22fbe34-063b-45e4-9143-abef26a14d30 with Priority: HIGHEST for action port [ 745.891692] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 934be6c8-f61f-4a11-9b02-e48c8e4ae509 with Priority: HIGHEST for action security_group_rules [ 745.891835] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 934be6c8-f61f-4a11-9b02-e48c8e4ae509 with Priority: HIGHEST for action security_group_members [ 745.891935] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a22fbe34-063b-45e4-9143-abef26a14d30 with Priority: HIGHEST for action port [ 745.892304] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock rules-934be6c8-f61f-4a11-9b02-e48c8e4ae509 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.892547] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-934be6c8-f61f-4a11-9b02-e48c8e4ae509" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.892547] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-934be6c8-f61f-4a11-9b02-e48c8e4ae509" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.893047] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-934be6c8-f61f-4a11-9b02-e48c8e4ae509" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.893146] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('934be6c8-f61f-4a11-9b02-e48c8e4ae509',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 745.893997] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-934be6c8-f61f-4a11-9b02-e48c8e4ae509 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.894131] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-934be6c8-f61f-4a11-9b02-e48c8e4ae509" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.894219] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-934be6c8-f61f-4a11-9b02-e48c8e4ae509" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.894393] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-934be6c8-f61f-4a11-9b02-e48c8e4ae509" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.894542] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.894639] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.894705] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.894858] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.894943] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.895044] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('934be6c8-f61f-4a11-9b02-e48c8e4ae509',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 745.895801] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock port-a22fbe34-063b-45e4-9143-abef26a14d30 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.895935] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a22fbe34-063b-45e4-9143-abef26a14d30" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.895986] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a22fbe34-063b-45e4-9143-abef26a14d30" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.896802] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a22fbe34-063b-45e4-9143-abef26a14d30" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.896802] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a22fbe34-063b-45e4-9143-abef26a14d30',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 745.910688] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-4e234e08-a192-4c7a-badf-3e57629854d7 taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.910688] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4e234e08-a192-4c7a-badf-3e57629854d7" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.910688] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4e234e08-a192-4c7a-badf-3e57629854d7" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.910688] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4e234e08-a192-4c7a-badf-3e57629854d7" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.910688] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.910688] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.910688] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.910688] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.910688] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.910688] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4e234e08-a192-4c7a-badf-3e57629854d7" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.910688] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-4e234e08-a192-4c7a-badf-3e57629854d7 taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.910688] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4e234e08-a192-4c7a-badf-3e57629854d7" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.910688] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4e234e08-a192-4c7a-badf-3e57629854d7" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.910688] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4e234e08-a192-4c7a-badf-3e57629854d7" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.910688] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.910688] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.911317] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.911317] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.911317] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.911317] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4e234e08-a192-4c7a-badf-3e57629854d7" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.911317] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4e234e08-a192-4c7a-badf-3e57629854d7',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 746.337089] env[65306]: INFO networking_nsxv3.common.synchronization [req-392fc6c4-9682-4a18-98a2-99d6511cc867 req-c38bb198-405c-4e46-81e4-707daa51854e tempest-SecurityGroupRulesNegativeTestJSON-874329279 tempest-SecurityGroupRulesNegativeTestJSON-874329279-project-member] Enqueued Resource ID: 369a26ad-1cc5-4a25-9feb-56c8a1101763 with Priority: HIGHEST for action security_group_rules [ 746.337786] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 369a26ad-1cc5-4a25-9feb-56c8a1101763 with Priority: HIGHEST for action security_group_rules [ 746.339555] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock rules-369a26ad-1cc5-4a25-9feb-56c8a1101763 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.339555] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-369a26ad-1cc5-4a25-9feb-56c8a1101763" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.339555] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-369a26ad-1cc5-4a25-9feb-56c8a1101763" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.339555] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-369a26ad-1cc5-4a25-9feb-56c8a1101763" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.339555] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('369a26ad-1cc5-4a25-9feb-56c8a1101763',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 746.398653] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-934be6c8-f61f-4a11-9b02-e48c8e4ae509 taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.398653] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-934be6c8-f61f-4a11-9b02-e48c8e4ae509" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.399444] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('934be6c8-f61f-4a11-9b02-e48c8e4ae509',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 746.401075] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a22fbe34-063b-45e4-9143-abef26a14d30 with status ACTIVE [ 746.401075] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.401075] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.402414] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.402558] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.402684] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.402922] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.403097] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.403193] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.403444] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.403501] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.403957] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.404102] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.404766] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.404766] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.404766] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.404766] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a22fbe34-063b-45e4-9143-abef26a14d30 is going to be updated. [ 746.418463] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4e234e08-a192-4c7a-badf-3e57629854d7: rpc.has_security_group_logging(os_id): False [ 746.434000] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.434265] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.434265] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.434481] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.434613] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.434926] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a22fbe34-063b-45e4-9143-abef26a14d30" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.437269] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.437379] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.437453] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.438261] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.438261] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.438261] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.438261] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.438261] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.438261] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.438504] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.438504] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.438569] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.438601] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.438749] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.438804] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.438973] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.439087] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.439147] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.439285] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.439359] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.439445] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4e234e08-a192-4c7a-badf-3e57629854d7 is going to be updated. [ 746.483144] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 30524546-2ed3-474c-bf2b-fc6aff50dfec in Status: SUCCESS [ 746.483320] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-30524546-2ed3-474c-bf2b-fc6aff50dfec" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.483514] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-30524546-2ed3-474c-bf2b-fc6aff50dfec" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.483915] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-30524546-2ed3-474c-bf2b-fc6aff50dfec" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.484205] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.484337] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.484413] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.484573] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.484667] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.484809] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-30524546-2ed3-474c-bf2b-fc6aff50dfec" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.486750] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('30524546-2ed3-474c-bf2b-fc6aff50dfec',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 746.523888] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.524289] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.524875] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.525035] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.525361] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.560485] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4e234e08-a192-4c7a-badf-3e57629854d7 in Status: IN_PROGRESS for 2s [ 746.874015] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.874015] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.874015] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.874015] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.874015] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.874015] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 369a26ad-1cc5-4a25-9feb-56c8a1101763 already deleted. [ 746.874015] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-369a26ad-1cc5-4a25-9feb-56c8a1101763" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.906743] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('934be6c8-f61f-4a11-9b02-e48c8e4ae509',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 746.989928] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('30524546-2ed3-474c-bf2b-fc6aff50dfec',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 747.027907] env[65306]: INFO networking_nsxv3.common.synchronization [None req-206642f0-7947-49a8-8506-de18f02ec379 None None] Enqueued Resource ID: 724ca644-cd77-455d-82ee-00c1b27a1e67 with Priority: HIGHEST for action port [ 747.028943] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 724ca644-cd77-455d-82ee-00c1b27a1e67 with Priority: HIGHEST for action port [ 747.031504] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock port-724ca644-cd77-455d-82ee-00c1b27a1e67 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.031695] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-724ca644-cd77-455d-82ee-00c1b27a1e67" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.031695] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-724ca644-cd77-455d-82ee-00c1b27a1e67" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.031865] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-724ca644-cd77-455d-82ee-00c1b27a1e67" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.031976] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('724ca644-cd77-455d-82ee-00c1b27a1e67',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 747.410591] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.413916] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.413916] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.413916] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.413916] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.413916] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 934be6c8-f61f-4a11-9b02-e48c8e4ae509 is going to be created. [ 747.449054] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.449054] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.449054] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.449054] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.449054] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.469704] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 934be6c8-f61f-4a11-9b02-e48c8e4ae509 in Status: UNINITIALIZED for 2s [ 747.498097] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 30524546-2ed3-474c-bf2b-fc6aff50dfec: rpc.has_security_group_logging(os_id): False [ 747.523717] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.523717] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.523717] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.523717] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.523717] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.523717] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.523717] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.523717] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.523717] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.523717] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.523717] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 30524546-2ed3-474c-bf2b-fc6aff50dfec is going to be updated. [ 747.534903] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 724ca644-cd77-455d-82ee-00c1b27a1e67 [ 747.535368] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.535714] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.535866] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.536155] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.536335] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.536511] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:724ca644-cd77-455d-82ee-00c1b27a1e67 already deleted. [ 747.536670] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-724ca644-cd77-455d-82ee-00c1b27a1e67" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.596250] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.596250] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.596250] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.596483] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.597204] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.614687] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 30524546-2ed3-474c-bf2b-fc6aff50dfec in Status: IN_PROGRESS for 2s [ 747.931417] env[65306]: INFO networking_nsxv3.common.synchronization [None req-3140691d-8cd4-442e-bdfc-cfd09dd9bff2 None None] Enqueued Resource ID: cae02fb8-e20e-4c5a-b7be-b3be22b80cba with Priority: HIGHEST for action port [ 747.933092] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cae02fb8-e20e-4c5a-b7be-b3be22b80cba with Priority: HIGHEST for action port [ 747.933092] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock port-cae02fb8-e20e-4c5a-b7be-b3be22b80cba taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.933092] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cae02fb8-e20e-4c5a-b7be-b3be22b80cba" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.933092] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cae02fb8-e20e-4c5a-b7be-b3be22b80cba" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.933307] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cae02fb8-e20e-4c5a-b7be-b3be22b80cba" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.933378] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cae02fb8-e20e-4c5a-b7be-b3be22b80cba',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 748.436653] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port cae02fb8-e20e-4c5a-b7be-b3be22b80cba [ 748.436977] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.437070] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.437179] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.437394] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.437507] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.437608] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:cae02fb8-e20e-4c5a-b7be-b3be22b80cba already deleted. [ 748.437728] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cae02fb8-e20e-4c5a-b7be-b3be22b80cba" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.581935] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4e234e08-a192-4c7a-badf-3e57629854d7 in Status: SUCCESS [ 748.582669] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4e234e08-a192-4c7a-badf-3e57629854d7" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.591131] env[65306]: INFO networking_nsxv3.common.synchronization [req-2d95e4b6-14c0-4cc5-ad91-08d8e923885d req-21e41407-66e5-4eb3-a235-22fc25e7fb85 tempest-AttachInterfacesUnderV243Test-82564794 tempest-AttachInterfacesUnderV243Test-82564794-project-member] Enqueued Resource ID: 30524546-2ed3-474c-bf2b-fc6aff50dfec with Priority: HIGHEST for action security_group_members [ 748.591753] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 30524546-2ed3-474c-bf2b-fc6aff50dfec with Priority: HIGHEST for action security_group_members [ 748.591753] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-30524546-2ed3-474c-bf2b-fc6aff50dfec taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.591925] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-30524546-2ed3-474c-bf2b-fc6aff50dfec" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.592033] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-30524546-2ed3-474c-bf2b-fc6aff50dfec" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.593247] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-30524546-2ed3-474c-bf2b-fc6aff50dfec" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.593414] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.595488] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.595488] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.595488] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.595488] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.595488] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('30524546-2ed3-474c-bf2b-fc6aff50dfec',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 748.612848] env[65306]: INFO networking_nsxv3.common.synchronization [req-2d95e4b6-14c0-4cc5-ad91-08d8e923885d req-21e41407-66e5-4eb3-a235-22fc25e7fb85 tempest-AttachInterfacesUnderV243Test-82564794 tempest-AttachInterfacesUnderV243Test-82564794-project-member] Enqueued Resource ID: 30524546-2ed3-474c-bf2b-fc6aff50dfec with Priority: HIGHEST for action security_group_rules [ 748.613058] env[65306]: INFO networking_nsxv3.common.synchronization [req-2d95e4b6-14c0-4cc5-ad91-08d8e923885d req-21e41407-66e5-4eb3-a235-22fc25e7fb85 tempest-AttachInterfacesUnderV243Test-82564794 tempest-AttachInterfacesUnderV243Test-82564794-project-member] Enqueued Resource ID: 30524546-2ed3-474c-bf2b-fc6aff50dfec with Priority: HIGHEST for action security_group_members [ 748.613208] env[65306]: INFO networking_nsxv3.common.synchronization [req-2d95e4b6-14c0-4cc5-ad91-08d8e923885d req-21e41407-66e5-4eb3-a235-22fc25e7fb85 tempest-AttachInterfacesUnderV243Test-82564794 tempest-AttachInterfacesUnderV243Test-82564794-project-member] Enqueued Resource ID: c9f5e340-cd10-4011-b7e7-487fee143966 with Priority: HIGHEST for action port [ 748.614107] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 30524546-2ed3-474c-bf2b-fc6aff50dfec with Priority: HIGHEST for action security_group_rules [ 748.614252] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 30524546-2ed3-474c-bf2b-fc6aff50dfec with Priority: HIGHEST for action security_group_members [ 748.614295] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c9f5e340-cd10-4011-b7e7-487fee143966 with Priority: HIGHEST for action port [ 748.614587] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock rules-30524546-2ed3-474c-bf2b-fc6aff50dfec taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.614749] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-30524546-2ed3-474c-bf2b-fc6aff50dfec" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.614974] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-30524546-2ed3-474c-bf2b-fc6aff50dfec taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.615067] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-30524546-2ed3-474c-bf2b-fc6aff50dfec" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.615308] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock port-c9f5e340-cd10-4011-b7e7-487fee143966 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.615352] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c9f5e340-cd10-4011-b7e7-487fee143966" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.615741] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c9f5e340-cd10-4011-b7e7-487fee143966" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.615741] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c9f5e340-cd10-4011-b7e7-487fee143966" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.615815] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c9f5e340-cd10-4011-b7e7-487fee143966',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 749.096855] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('30524546-2ed3-474c-bf2b-fc6aff50dfec',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 749.118271] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c9f5e340-cd10-4011-b7e7-487fee143966 with status ACTIVE [ 749.118562] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.118673] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.118871] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.119051] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.119147] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.119326] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.119433] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.119502] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.119681] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.119756] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.119993] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.120131] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.120246] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.120400] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.120575] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.120613] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c9f5e340-cd10-4011-b7e7-487fee143966 is going to be updated. [ 749.147993] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.147993] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.147993] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.147993] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.148691] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.148691] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c9f5e340-cd10-4011-b7e7-487fee143966" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.339899] env[65306]: INFO networking_nsxv3.common.synchronization [req-1dd1ad7a-7137-4a9b-800a-ce392befd67f req-9c950e35-a777-42de-9ac8-b8babaa4a585 tempest-ImagesOneServerNegativeTestJSON-105192947 tempest-ImagesOneServerNegativeTestJSON-105192947-project-member] Enqueued Resource ID: aceee07e-3675-474c-96e8-9fe510f1356f with Priority: HIGHEST for action security_group_members [ 749.344061] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aceee07e-3675-474c-96e8-9fe510f1356f with Priority: HIGHEST for action security_group_members [ 749.344061] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-aceee07e-3675-474c-96e8-9fe510f1356f taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.344061] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aceee07e-3675-474c-96e8-9fe510f1356f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.344061] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aceee07e-3675-474c-96e8-9fe510f1356f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.344061] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aceee07e-3675-474c-96e8-9fe510f1356f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.344061] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.344061] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.344061] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.344061] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.344061] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.344061] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('aceee07e-3675-474c-96e8-9fe510f1356f',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 749.483028] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 934be6c8-f61f-4a11-9b02-e48c8e4ae509 in Status: SUCCESS [ 749.483308] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-934be6c8-f61f-4a11-9b02-e48c8e4ae509" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.483436] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-934be6c8-f61f-4a11-9b02-e48c8e4ae509" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.483620] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-934be6c8-f61f-4a11-9b02-e48c8e4ae509" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.483947] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.483947] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.484128] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.484234] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.484234] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.484295] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-934be6c8-f61f-4a11-9b02-e48c8e4ae509" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.485190] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('934be6c8-f61f-4a11-9b02-e48c8e4ae509',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 749.600091] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('30524546-2ed3-474c-bf2b-fc6aff50dfec',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 749.631309] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 30524546-2ed3-474c-bf2b-fc6aff50dfec in Status: SUCCESS [ 749.631486] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-30524546-2ed3-474c-bf2b-fc6aff50dfec" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.631709] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-30524546-2ed3-474c-bf2b-fc6aff50dfec" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.631879] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-30524546-2ed3-474c-bf2b-fc6aff50dfec" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.631984] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('30524546-2ed3-474c-bf2b-fc6aff50dfec',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 749.850024] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.850024] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.850024] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.850024] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.850024] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.850024] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.850024] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.850024] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.850024] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.850024] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.850024] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aceee07e-3675-474c-96e8-9fe510f1356f is going to be updated. [ 749.881454] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.882943] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.883027] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.883355] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.883536] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.893911] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aceee07e-3675-474c-96e8-9fe510f1356f in Status: IN_PROGRESS for 2s [ 749.990119] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-934be6c8-f61f-4a11-9b02-e48c8e4ae509 taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.990119] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-934be6c8-f61f-4a11-9b02-e48c8e4ae509" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.990119] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-934be6c8-f61f-4a11-9b02-e48c8e4ae509" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.990119] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-934be6c8-f61f-4a11-9b02-e48c8e4ae509" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.990119] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.990119] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.990119] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.990119] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.990119] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.990119] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-934be6c8-f61f-4a11-9b02-e48c8e4ae509" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.990119] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-934be6c8-f61f-4a11-9b02-e48c8e4ae509 taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.990119] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-934be6c8-f61f-4a11-9b02-e48c8e4ae509" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.990119] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-934be6c8-f61f-4a11-9b02-e48c8e4ae509" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.990119] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-934be6c8-f61f-4a11-9b02-e48c8e4ae509" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.990119] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.990119] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.990643] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.990643] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.990643] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.990643] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-934be6c8-f61f-4a11-9b02-e48c8e4ae509" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.990643] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('934be6c8-f61f-4a11-9b02-e48c8e4ae509',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 750.106274] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.106896] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.106896] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.107177] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.107509] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.107509] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 30524546-2ed3-474c-bf2b-fc6aff50dfec is going to be updated. [ 750.135192] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-30524546-2ed3-474c-bf2b-fc6aff50dfec taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.135733] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-30524546-2ed3-474c-bf2b-fc6aff50dfec" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.140521] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.140948] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.141228] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.141687] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.142259] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.156029] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 30524546-2ed3-474c-bf2b-fc6aff50dfec in Status: IN_PROGRESS for 2s [ 750.493402] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 934be6c8-f61f-4a11-9b02-e48c8e4ae509: rpc.has_security_group_logging(os_id): False [ 750.514473] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.514661] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.514705] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.515203] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.515340] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.515566] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.515705] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.515769] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.515938] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.516095] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.516299] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.516735] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.516808] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.516962] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.517049] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.517304] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.517418] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.517452] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.517802] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.517884] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.517975] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 934be6c8-f61f-4a11-9b02-e48c8e4ae509 is going to be created. [ 750.611655] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.611860] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.611860] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.613023] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.613023] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.629310] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 934be6c8-f61f-4a11-9b02-e48c8e4ae509 in Status: IN_PROGRESS for 2s [ 751.102408] env[65306]: INFO networking_nsxv3.common.synchronization [None req-2849eeca-17a5-4ff0-89b6-a59ee61dc001 None None] Enqueued Resource ID: 0f8a2afd-6c92-414b-8325-e60cd60c8214 with Priority: HIGHEST for action port [ 751.103119] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0f8a2afd-6c92-414b-8325-e60cd60c8214 with Priority: HIGHEST for action port [ 751.103267] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock port-0f8a2afd-6c92-414b-8325-e60cd60c8214 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.106485] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0f8a2afd-6c92-414b-8325-e60cd60c8214" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.106485] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0f8a2afd-6c92-414b-8325-e60cd60c8214" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.106485] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0f8a2afd-6c92-414b-8325-e60cd60c8214" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.106485] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0f8a2afd-6c92-414b-8325-e60cd60c8214',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 751.205126] env[65306]: INFO networking_nsxv3.common.synchronization [None req-1defcfd8-64df-4349-b9eb-af1d58dd9811 tempest-ServersTestJSON-1200400240 tempest-ServersTestJSON-1200400240-project-member] Enqueued Resource ID: c90bbe47-7f68-400a-a228-2030ba9cad31 with Priority: HIGHEST for action security_group_rules [ 751.205700] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c90bbe47-7f68-400a-a228-2030ba9cad31 with Priority: HIGHEST for action security_group_rules [ 751.205998] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c90bbe47-7f68-400a-a228-2030ba9cad31 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.206168] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c90bbe47-7f68-400a-a228-2030ba9cad31" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.207338] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c90bbe47-7f68-400a-a228-2030ba9cad31" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.207338] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c90bbe47-7f68-400a-a228-2030ba9cad31" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.207493] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c90bbe47-7f68-400a-a228-2030ba9cad31',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 751.495457] env[65306]: INFO networking_nsxv3.common.synchronization [None req-b6fff889-7b9a-407e-bf8b-63626f9665ab tempest-ServersTestJSON-1200400240 tempest-ServersTestJSON-1200400240-project-member] Enqueued Resource ID: c90bbe47-7f68-400a-a228-2030ba9cad31 with Priority: HIGHEST for action security_group_rules [ 751.496198] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c90bbe47-7f68-400a-a228-2030ba9cad31 with Priority: HIGHEST for action security_group_rules [ 751.496332] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c90bbe47-7f68-400a-a228-2030ba9cad31 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.496467] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c90bbe47-7f68-400a-a228-2030ba9cad31" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.606490] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0f8a2afd-6c92-414b-8325-e60cd60c8214 [ 751.610203] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.610203] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.610203] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.610203] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.610203] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.610203] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0f8a2afd-6c92-414b-8325-e60cd60c8214 already deleted. [ 751.610203] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0f8a2afd-6c92-414b-8325-e60cd60c8214" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.737509] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.737709] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.737766] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.738012] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.738145] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.738253] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c90bbe47-7f68-400a-a228-2030ba9cad31 already deleted. [ 751.738356] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c90bbe47-7f68-400a-a228-2030ba9cad31" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.738516] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c90bbe47-7f68-400a-a228-2030ba9cad31" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.738701] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c90bbe47-7f68-400a-a228-2030ba9cad31" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.738789] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c90bbe47-7f68-400a-a228-2030ba9cad31',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 751.905379] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aceee07e-3675-474c-96e8-9fe510f1356f in Status: SUCCESS [ 751.905545] env[65306]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aceee07e-3675-474c-96e8-9fe510f1356f deletion is rescheduled due to dependency. [ 751.905624] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aceee07e-3675-474c-96e8-9fe510f1356f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.167623] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 30524546-2ed3-474c-bf2b-fc6aff50dfec in Status: SUCCESS [ 752.168251] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-30524546-2ed3-474c-bf2b-fc6aff50dfec" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.168495] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-30524546-2ed3-474c-bf2b-fc6aff50dfec" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.168811] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-30524546-2ed3-474c-bf2b-fc6aff50dfec" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.169017] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.169269] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.169356] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.169577] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.169714] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.170150] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('30524546-2ed3-474c-bf2b-fc6aff50dfec',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 752.264037] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.264214] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.264214] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.264857] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.264857] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.264857] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c90bbe47-7f68-400a-a228-2030ba9cad31 already deleted. [ 752.264857] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c90bbe47-7f68-400a-a228-2030ba9cad31" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.649773] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 934be6c8-f61f-4a11-9b02-e48c8e4ae509 in Status: SUCCESS [ 752.650144] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-934be6c8-f61f-4a11-9b02-e48c8e4ae509" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.675552] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('30524546-2ed3-474c-bf2b-fc6aff50dfec',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 753.180020] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('30524546-2ed3-474c-bf2b-fc6aff50dfec',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 753.683176] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.683176] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.683176] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.683176] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.683176] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.683176] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 30524546-2ed3-474c-bf2b-fc6aff50dfec is going to be updated. [ 753.721395] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.721616] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.721616] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.721853] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.721951] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.734962] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 30524546-2ed3-474c-bf2b-fc6aff50dfec in Status: IN_PROGRESS for 2s [ 754.850468] env[65306]: INFO networking_nsxv3.common.synchronization [req-29fa3e78-6735-44f7-8529-34e37fa59f91 req-bd0ac8f0-cfb2-485b-8e83-d4811dcc72d0 tempest-ServersV294TestFqdnHostnames-853342652 tempest-ServersV294TestFqdnHostnames-853342652-project-member] Enqueued Resource ID: 18bb45c8-7cab-44a5-887c-82deb65b8e26 with Priority: HIGHEST for action security_group_members [ 754.850468] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 18bb45c8-7cab-44a5-887c-82deb65b8e26 with Priority: HIGHEST for action security_group_members [ 754.850468] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-18bb45c8-7cab-44a5-887c-82deb65b8e26 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.850468] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-18bb45c8-7cab-44a5-887c-82deb65b8e26" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.850468] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-18bb45c8-7cab-44a5-887c-82deb65b8e26" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.851415] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-18bb45c8-7cab-44a5-887c-82deb65b8e26" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.851727] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.851956] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.852117] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.852399] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.852570] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.852743] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('18bb45c8-7cab-44a5-887c-82deb65b8e26',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 755.266687] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock network-141 taken with stack trace [, , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.267081] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "network-141" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.267560] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "network-141" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.267560] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "network-141" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.269041] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.269041] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.269041] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.269041] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.269041] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.269041] env[65306]: DEBUG dogpile.cache.region [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] No value present for key: 'zone-id' {{(pid=65306) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 755.269041] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] NeedRegenerationException {{(pid=65306) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 755.269597] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] no value, waiting for create lock {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 755.269597] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] value creation lock acquired {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 755.269597] env[65306]: DEBUG dogpile.cache.region [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] No value present for key: 'zone-id' {{(pid=65306) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 755.269597] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Calling creation function for not-yet-present value {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 755.269597] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 755.291488] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 755.291655] env[65306]: DEBUG dogpile.cache.region [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65306) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 755.291791] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Released creation lock {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 755.291958] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "network-141" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.292305] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock port-7913bb27-9258-430d-a87e-c81eff9b717e taken with stack trace [, , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.292477] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "port-7913bb27-9258-430d-a87e-c81eff9b717e" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.292588] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "port-7913bb27-9258-430d-a87e-c81eff9b717e" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.293655] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "port-7913bb27-9258-430d-a87e-c81eff9b717e" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.296036] env[65306]: DEBUG networking_nsxv3.api.rpc [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7913bb27-9258-430d-a87e-c81eff9b717e',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 755.355025] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.355638] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.355745] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.355968] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.356075] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.356283] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.356386] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.356449] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.356600] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.356675] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.356759] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 18bb45c8-7cab-44a5-887c-82deb65b8e26 already deleted. [ 755.356837] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-18bb45c8-7cab-44a5-887c-82deb65b8e26" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.759180] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 30524546-2ed3-474c-bf2b-fc6aff50dfec in Status: SUCCESS [ 755.759571] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-30524546-2ed3-474c-bf2b-fc6aff50dfec" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.760359] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-30524546-2ed3-474c-bf2b-fc6aff50dfec" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.760359] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-30524546-2ed3-474c-bf2b-fc6aff50dfec" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.760359] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.760599] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.760599] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.760684] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.760723] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.761177] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-30524546-2ed3-474c-bf2b-fc6aff50dfec" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.761177] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('30524546-2ed3-474c-bf2b-fc6aff50dfec',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 755.801342] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.802482] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.802482] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.802482] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.802482] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.802804] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Segment Port 7913bb27-9258-430d-a87e-c81eff9b717e not found, creating... [ 755.802869] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.803334] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.803334] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.803768] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.806930] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.806930] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.806930] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.806930] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.806930] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.806930] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.806930] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Resource: SegmentPort with ID: 7913bb27-9258-430d-a87e-c81eff9b717e is going to be created. [ 755.831621] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.831861] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.831933] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.832203] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.833286] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.833286] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "port-7913bb27-9258-430d-a87e-c81eff9b717e" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.264355] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('30524546-2ed3-474c-bf2b-fc6aff50dfec',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 756.621901] env[65306]: INFO networking_nsxv3.common.synchronization [req-29fa3e78-6735-44f7-8529-34e37fa59f91 req-1c421543-ec75-4f77-becf-e5daaa40e7dd service nova] Enqueued Resource ID: 18bb45c8-7cab-44a5-887c-82deb65b8e26 with Priority: HIGHEST for action security_group_rules [ 756.622207] env[65306]: INFO networking_nsxv3.common.synchronization [req-29fa3e78-6735-44f7-8529-34e37fa59f91 req-1c421543-ec75-4f77-becf-e5daaa40e7dd service nova] Enqueued Resource ID: 18bb45c8-7cab-44a5-887c-82deb65b8e26 with Priority: HIGHEST for action security_group_members [ 756.622457] env[65306]: INFO networking_nsxv3.common.synchronization [req-29fa3e78-6735-44f7-8529-34e37fa59f91 req-1c421543-ec75-4f77-becf-e5daaa40e7dd service nova] Enqueued Resource ID: 7913bb27-9258-430d-a87e-c81eff9b717e with Priority: HIGHEST for action port [ 756.623081] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 18bb45c8-7cab-44a5-887c-82deb65b8e26 with Priority: HIGHEST for action security_group_rules [ 756.623314] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 18bb45c8-7cab-44a5-887c-82deb65b8e26 with Priority: HIGHEST for action security_group_members [ 756.623502] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7913bb27-9258-430d-a87e-c81eff9b717e with Priority: HIGHEST for action port [ 756.623847] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock rules-18bb45c8-7cab-44a5-887c-82deb65b8e26 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.624010] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-18bb45c8-7cab-44a5-887c-82deb65b8e26" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.624110] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-18bb45c8-7cab-44a5-887c-82deb65b8e26" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.625353] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-18bb45c8-7cab-44a5-887c-82deb65b8e26" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.625353] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('18bb45c8-7cab-44a5-887c-82deb65b8e26',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 756.625612] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-18bb45c8-7cab-44a5-887c-82deb65b8e26 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.625612] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-18bb45c8-7cab-44a5-887c-82deb65b8e26" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.625744] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-18bb45c8-7cab-44a5-887c-82deb65b8e26" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.626753] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-18bb45c8-7cab-44a5-887c-82deb65b8e26" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.626753] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.626753] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.626753] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.626753] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.626753] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.626753] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('18bb45c8-7cab-44a5-887c-82deb65b8e26',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 756.627756] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock port-7913bb27-9258-430d-a87e-c81eff9b717e taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.627892] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7913bb27-9258-430d-a87e-c81eff9b717e" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.627983] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7913bb27-9258-430d-a87e-c81eff9b717e" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.628177] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7913bb27-9258-430d-a87e-c81eff9b717e" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.628285] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7913bb27-9258-430d-a87e-c81eff9b717e',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 756.769051] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 30524546-2ed3-474c-bf2b-fc6aff50dfec: rpc.has_security_group_logging(os_id): False [ 756.788167] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.788323] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.788388] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.788657] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.788760] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.789025] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.789152] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.789428] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.789494] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.789582] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.789675] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 30524546-2ed3-474c-bf2b-fc6aff50dfec is going to be updated. [ 756.859728] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.859955] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.860059] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.860318] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.860532] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.882849] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 30524546-2ed3-474c-bf2b-fc6aff50dfec in Status: IN_PROGRESS for 2s [ 757.131537] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('18bb45c8-7cab-44a5-887c-82deb65b8e26',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 757.132488] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-18bb45c8-7cab-44a5-887c-82deb65b8e26 taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.132605] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-18bb45c8-7cab-44a5-887c-82deb65b8e26" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.132730] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7913bb27-9258-430d-a87e-c81eff9b717e with status ACTIVE [ 757.132884] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.132990] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.133152] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.136747] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.137126] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.137126] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.137320] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.137320] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.137648] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.137648] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.137884] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.137884] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.137884] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.138061] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.138061] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.138158] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7913bb27-9258-430d-a87e-c81eff9b717e is going to be updated. [ 757.162928] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.163205] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.163205] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.164981] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.164981] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.164981] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7913bb27-9258-430d-a87e-c81eff9b717e" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.399432] env[65306]: INFO networking_nsxv3.common.synchronization [req-8278bfbb-e307-4524-b739-d7eeb9831de8 req-423fd5bc-ebaa-4492-be66-a22db5076128 tempest-ServerRescueTestJSONUnderV235-1743615611 tempest-ServerRescueTestJSONUnderV235-1743615611-project-member] Enqueued Resource ID: 41ddc5e2-3eff-4217-8312-ffe238697b2c with Priority: HIGHEST for action security_group_members [ 757.400733] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 41ddc5e2-3eff-4217-8312-ffe238697b2c with Priority: HIGHEST for action security_group_members [ 757.400733] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-41ddc5e2-3eff-4217-8312-ffe238697b2c taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.400733] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-41ddc5e2-3eff-4217-8312-ffe238697b2c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.400733] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-41ddc5e2-3eff-4217-8312-ffe238697b2c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.401167] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-41ddc5e2-3eff-4217-8312-ffe238697b2c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.401342] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.401467] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.401559] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.401763] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.401957] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.402033] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('41ddc5e2-3eff-4217-8312-ffe238697b2c',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 757.425433] env[65306]: INFO networking_nsxv3.common.synchronization [req-c6d0ce24-800b-4da8-8412-321c71a2a6b0 req-4742594b-a6c8-46e8-a366-0843421eec11 tempest-AttachInterfacesUnderV243Test-82564794 tempest-AttachInterfacesUnderV243Test-82564794-project-member] Enqueued Resource ID: 30524546-2ed3-474c-bf2b-fc6aff50dfec with Priority: HIGHEST for action security_group_members [ 757.427052] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 30524546-2ed3-474c-bf2b-fc6aff50dfec with Priority: HIGHEST for action security_group_members [ 757.427504] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-30524546-2ed3-474c-bf2b-fc6aff50dfec taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.427678] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-30524546-2ed3-474c-bf2b-fc6aff50dfec" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.427904] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-30524546-2ed3-474c-bf2b-fc6aff50dfec" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.428213] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-30524546-2ed3-474c-bf2b-fc6aff50dfec" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.428463] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.428621] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.428720] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.428976] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.429132] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.429290] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('30524546-2ed3-474c-bf2b-fc6aff50dfec',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 757.642259] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('18bb45c8-7cab-44a5-887c-82deb65b8e26',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 757.904645] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.904796] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.905814] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.905814] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.905814] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.905814] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.905814] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.905814] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.905814] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.905814] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.906129] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 41ddc5e2-3eff-4217-8312-ffe238697b2c already deleted. [ 757.906129] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-41ddc5e2-3eff-4217-8312-ffe238697b2c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.933713] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.933874] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.933943] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.934197] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.934298] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.934731] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.934731] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.934731] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.935489] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.935489] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.935489] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 30524546-2ed3-474c-bf2b-fc6aff50dfec is going to be updated. [ 757.938679] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock network-798 taken with stack trace [, , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.939010] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "network-798" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.939199] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "network-798" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.940038] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "network-798" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.940357] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.941083] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.941083] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.941083] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.941215] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.941472] env[65306]: DEBUG dogpile.cache.region [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] No value present for key: 'zone-id' {{(pid=65306) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 757.941472] env[65306]: DEBUG dogpile.lock [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] NeedRegenerationException {{(pid=65306) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 757.941619] env[65306]: DEBUG dogpile.lock [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] no value, waiting for create lock {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 757.941655] env[65306]: DEBUG dogpile.lock [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] value creation lock acquired {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 757.941770] env[65306]: DEBUG dogpile.cache.region [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] No value present for key: 'zone-id' {{(pid=65306) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 757.941881] env[65306]: DEBUG dogpile.lock [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Calling creation function for not-yet-present value {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 757.942090] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 757.967526] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 757.967744] env[65306]: DEBUG dogpile.cache.region [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=65306) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 757.967854] env[65306]: DEBUG dogpile.lock [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Released creation lock {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 757.968061] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "network-798" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.968384] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock port-01326337-1730-4c11-8d67-5edeeb790689 taken with stack trace [, , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.968561] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "port-01326337-1730-4c11-8d67-5edeeb790689" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.968676] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "port-01326337-1730-4c11-8d67-5edeeb790689" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.969041] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "port-01326337-1730-4c11-8d67-5edeeb790689" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.969142] env[65306]: DEBUG networking_nsxv3.api.rpc [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('01326337-1730-4c11-8d67-5edeeb790689',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 757.976970] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.977181] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.977886] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.977886] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.977886] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.989832] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 30524546-2ed3-474c-bf2b-fc6aff50dfec in Status: IN_PROGRESS for 2s [ 758.146020] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.146020] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.146020] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.146020] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.146020] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.146020] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 18bb45c8-7cab-44a5-887c-82deb65b8e26 is going to be created. [ 758.175330] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.175626] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.175738] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.175963] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.176101] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.188516] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 18bb45c8-7cab-44a5-887c-82deb65b8e26 in Status: UNINITIALIZED for 2s [ 758.472966] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.473385] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.473385] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.473706] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.473854] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.474066] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Segment Port 01326337-1730-4c11-8d67-5edeeb790689 not found, creating... [ 758.474312] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.474489] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.474601] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.474823] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.474957] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.475254] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.475407] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.475514] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.475836] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.475836] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.476064] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Resource: SegmentPort with ID: 01326337-1730-4c11-8d67-5edeeb790689 is going to be created. [ 758.498316] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.498526] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.498727] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.502215] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.502215] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.502215] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "port-01326337-1730-4c11-8d67-5edeeb790689" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.900278] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 30524546-2ed3-474c-bf2b-fc6aff50dfec in Status: SUCCESS [ 758.900734] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-30524546-2ed3-474c-bf2b-fc6aff50dfec" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.285193] env[65306]: INFO networking_nsxv3.common.synchronization [req-8278bfbb-e307-4524-b739-d7eeb9831de8 req-3e0bdbc2-9404-4a47-9c76-137772bbf109 service nova] Enqueued Resource ID: 41ddc5e2-3eff-4217-8312-ffe238697b2c with Priority: HIGHEST for action security_group_rules [ 759.285193] env[65306]: INFO networking_nsxv3.common.synchronization [req-8278bfbb-e307-4524-b739-d7eeb9831de8 req-3e0bdbc2-9404-4a47-9c76-137772bbf109 service nova] Enqueued Resource ID: 41ddc5e2-3eff-4217-8312-ffe238697b2c with Priority: HIGHEST for action security_group_members [ 759.285307] env[65306]: INFO networking_nsxv3.common.synchronization [req-8278bfbb-e307-4524-b739-d7eeb9831de8 req-3e0bdbc2-9404-4a47-9c76-137772bbf109 service nova] Enqueued Resource ID: 01326337-1730-4c11-8d67-5edeeb790689 with Priority: HIGHEST for action port [ 759.285910] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 41ddc5e2-3eff-4217-8312-ffe238697b2c with Priority: HIGHEST for action security_group_rules [ 759.286067] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 41ddc5e2-3eff-4217-8312-ffe238697b2c with Priority: HIGHEST for action security_group_members [ 759.286167] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 01326337-1730-4c11-8d67-5edeeb790689 with Priority: HIGHEST for action port [ 759.286556] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock rules-41ddc5e2-3eff-4217-8312-ffe238697b2c taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.286705] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-41ddc5e2-3eff-4217-8312-ffe238697b2c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.286762] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-41ddc5e2-3eff-4217-8312-ffe238697b2c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.287101] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-41ddc5e2-3eff-4217-8312-ffe238697b2c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.287190] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('41ddc5e2-3eff-4217-8312-ffe238697b2c',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 759.288299] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-41ddc5e2-3eff-4217-8312-ffe238697b2c taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.288473] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-41ddc5e2-3eff-4217-8312-ffe238697b2c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.288543] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-41ddc5e2-3eff-4217-8312-ffe238697b2c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.288752] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-41ddc5e2-3eff-4217-8312-ffe238697b2c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.289027] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.289113] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.289204] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.289958] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.289958] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.289958] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('41ddc5e2-3eff-4217-8312-ffe238697b2c',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 759.291037] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock port-01326337-1730-4c11-8d67-5edeeb790689 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.291037] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-01326337-1730-4c11-8d67-5edeeb790689" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.291037] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-01326337-1730-4c11-8d67-5edeeb790689" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.291251] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-01326337-1730-4c11-8d67-5edeeb790689" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.291251] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('01326337-1730-4c11-8d67-5edeeb790689',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 759.793094] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-41ddc5e2-3eff-4217-8312-ffe238697b2c taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.793362] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-41ddc5e2-3eff-4217-8312-ffe238697b2c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.793435] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('41ddc5e2-3eff-4217-8312-ffe238697b2c',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 759.794346] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 01326337-1730-4c11-8d67-5edeeb790689 with status ACTIVE [ 759.794535] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.794652] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.794720] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.794953] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.795022] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.795192] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.795301] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.795365] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.795511] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.795589] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.795767] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.795858] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.795919] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.796350] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.796485] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.796630] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 01326337-1730-4c11-8d67-5edeeb790689 is going to be updated. [ 759.840045] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.840045] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.840045] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.840502] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.840502] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.840651] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-01326337-1730-4c11-8d67-5edeeb790689" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.002492] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 30524546-2ed3-474c-bf2b-fc6aff50dfec in Status: SUCCESS [ 760.002705] env[65306]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 30524546-2ed3-474c-bf2b-fc6aff50dfec deletion is rescheduled due to dependency. [ 760.002903] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-30524546-2ed3-474c-bf2b-fc6aff50dfec" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.200200] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 18bb45c8-7cab-44a5-887c-82deb65b8e26 in Status: SUCCESS [ 760.200968] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-18bb45c8-7cab-44a5-887c-82deb65b8e26" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.200968] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-18bb45c8-7cab-44a5-887c-82deb65b8e26" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.200968] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-18bb45c8-7cab-44a5-887c-82deb65b8e26" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.201170] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.201237] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.201273] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.201446] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.201531] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.201620] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-18bb45c8-7cab-44a5-887c-82deb65b8e26" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.201712] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('18bb45c8-7cab-44a5-887c-82deb65b8e26',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 760.229225] env[65306]: INFO networking_nsxv3.common.synchronization [req-6e246221-3025-4ce1-9b0a-bf1bce7549ea req-f71266b4-e1ff-4046-9ab2-42484f45c861 tempest-FloatingIPsAssociationTestJSON-1677333687 tempest-FloatingIPsAssociationTestJSON-1677333687-project-member] Enqueued Resource ID: 3eee5457-701b-405e-bdf2-f055e0150d49 with Priority: HIGHEST for action security_group_members [ 760.229823] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3eee5457-701b-405e-bdf2-f055e0150d49 with Priority: HIGHEST for action security_group_members [ 760.230287] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-3eee5457-701b-405e-bdf2-f055e0150d49 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.230419] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3eee5457-701b-405e-bdf2-f055e0150d49" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.230486] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3eee5457-701b-405e-bdf2-f055e0150d49" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.230698] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3eee5457-701b-405e-bdf2-f055e0150d49" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.230853] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.230980] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.231058] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.231219] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.231303] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.231400] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3eee5457-701b-405e-bdf2-f055e0150d49',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 760.302471] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('41ddc5e2-3eff-4217-8312-ffe238697b2c',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 760.600883] env[65306]: INFO networking_nsxv3.common.synchronization [req-8f64c081-c546-4c53-bccb-0be0e2b63180 req-14c66750-0c7e-420b-ba8a-a761993d8368 tempest-InstanceActionsNegativeTestJSON-887815147 tempest-InstanceActionsNegativeTestJSON-887815147-project-member] Enqueued Resource ID: 934be6c8-f61f-4a11-9b02-e48c8e4ae509 with Priority: HIGHEST for action security_group_members [ 760.601652] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 934be6c8-f61f-4a11-9b02-e48c8e4ae509 with Priority: HIGHEST for action security_group_members [ 760.602060] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-934be6c8-f61f-4a11-9b02-e48c8e4ae509 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.602220] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-934be6c8-f61f-4a11-9b02-e48c8e4ae509" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.602312] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-934be6c8-f61f-4a11-9b02-e48c8e4ae509" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.602567] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-934be6c8-f61f-4a11-9b02-e48c8e4ae509" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.602766] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.602897] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.602987] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.603203] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.603325] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.603455] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('934be6c8-f61f-4a11-9b02-e48c8e4ae509',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 760.705479] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('18bb45c8-7cab-44a5-887c-82deb65b8e26',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 760.734931] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3eee5457-701b-405e-bdf2-f055e0150d49',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 760.738954] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock network-111 taken with stack trace [, , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.738954] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "network-111" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.738954] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "network-111" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.738954] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "network-111" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.740368] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.740570] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.740651] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.740902] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.741100] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.741322] env[65306]: DEBUG dogpile.cache.region [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] No value present for key: 'zone-id' {{(pid=65306) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 760.741446] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] NeedRegenerationException {{(pid=65306) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 760.741519] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] no value, waiting for create lock {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 760.741640] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] value creation lock acquired {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 760.741788] env[65306]: DEBUG dogpile.cache.region [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] No value present for key: 'zone-id' {{(pid=65306) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 760.741838] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Calling creation function for not-yet-present value {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 760.743446] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 760.767912] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 760.767912] env[65306]: DEBUG dogpile.cache.region [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=65306) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 760.768223] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Released creation lock {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 760.768223] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "network-111" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.768670] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock port-8f93c3af-9c27-410c-9e95-fc02f0e59041 taken with stack trace [, , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.768915] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "port-8f93c3af-9c27-410c-9e95-fc02f0e59041" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.769069] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "port-8f93c3af-9c27-410c-9e95-fc02f0e59041" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.769448] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "port-8f93c3af-9c27-410c-9e95-fc02f0e59041" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.769604] env[65306]: DEBUG networking_nsxv3.api.rpc [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8f93c3af-9c27-410c-9e95-fc02f0e59041',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 760.808260] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.808675] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.808675] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.808862] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.809027] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.809210] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 41ddc5e2-3eff-4217-8312-ffe238697b2c is going to be created. [ 760.843772] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.843935] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.844020] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.844272] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.844892] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.865952] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 41ddc5e2-3eff-4217-8312-ffe238697b2c in Status: UNINITIALIZED for 2s [ 761.107485] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.107810] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.107881] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.108141] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.108242] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.108492] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.108669] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.108735] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.108950] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.109064] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.109191] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 934be6c8-f61f-4a11-9b02-e48c8e4ae509 is going to be updated. [ 761.143141] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.143553] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.143710] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.143989] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.144157] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.158629] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 934be6c8-f61f-4a11-9b02-e48c8e4ae509 in Status: IN_PROGRESS for 2s [ 761.208046] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 18bb45c8-7cab-44a5-887c-82deb65b8e26: rpc.has_security_group_logging(os_id): False [ 761.227950] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.228158] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.228210] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.228454] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.228558] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.228810] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.229242] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.229242] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.229242] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.229242] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.229465] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 18bb45c8-7cab-44a5-887c-82deb65b8e26 is going to be created. [ 761.238378] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3eee5457-701b-405e-bdf2-f055e0150d49',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 761.272149] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.272424] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.272510] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.272784] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.272926] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.273103] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Segment Port 8f93c3af-9c27-410c-9e95-fc02f0e59041 not found, creating... [ 761.273445] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.273620] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.273736] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.273959] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.274107] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.274384] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.274535] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.274637] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.274842] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.274971] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.275121] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Resource: SegmentPort with ID: 8f93c3af-9c27-410c-9e95-fc02f0e59041 is going to be created. [ 761.299315] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.299591] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.299754] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.300059] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.300320] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.300571] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "port-8f93c3af-9c27-410c-9e95-fc02f0e59041" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.302276] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.302416] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.302599] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.302653] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.302814] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.325942] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 18bb45c8-7cab-44a5-887c-82deb65b8e26 in Status: IN_PROGRESS for 2s [ 761.741414] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.744130] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.744130] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.744130] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.744130] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.744130] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3eee5457-701b-405e-bdf2-f055e0150d49 is going to be updated. [ 761.777025] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.777025] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.777025] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.777025] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.777025] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.787163] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3eee5457-701b-405e-bdf2-f055e0150d49 in Status: IN_PROGRESS for 2s [ 762.078612] env[65306]: INFO networking_nsxv3.common.synchronization [req-6e246221-3025-4ce1-9b0a-bf1bce7549ea req-5ac277cb-17cd-453d-94a8-3696e8b63f6f service nova] Enqueued Resource ID: 3eee5457-701b-405e-bdf2-f055e0150d49 with Priority: HIGHEST for action security_group_rules [ 762.078973] env[65306]: INFO networking_nsxv3.common.synchronization [req-6e246221-3025-4ce1-9b0a-bf1bce7549ea req-5ac277cb-17cd-453d-94a8-3696e8b63f6f service nova] Enqueued Resource ID: 3eee5457-701b-405e-bdf2-f055e0150d49 with Priority: HIGHEST for action security_group_members [ 762.078973] env[65306]: INFO networking_nsxv3.common.synchronization [req-6e246221-3025-4ce1-9b0a-bf1bce7549ea req-5ac277cb-17cd-453d-94a8-3696e8b63f6f service nova] Enqueued Resource ID: 8f93c3af-9c27-410c-9e95-fc02f0e59041 with Priority: HIGHEST for action port [ 762.079538] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3eee5457-701b-405e-bdf2-f055e0150d49 with Priority: HIGHEST for action security_group_rules [ 762.079680] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3eee5457-701b-405e-bdf2-f055e0150d49 with Priority: HIGHEST for action security_group_members [ 762.079785] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8f93c3af-9c27-410c-9e95-fc02f0e59041 with Priority: HIGHEST for action port [ 762.080258] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3eee5457-701b-405e-bdf2-f055e0150d49 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.080392] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3eee5457-701b-405e-bdf2-f055e0150d49" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.080466] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3eee5457-701b-405e-bdf2-f055e0150d49" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.080672] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3eee5457-701b-405e-bdf2-f055e0150d49" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.080756] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3eee5457-701b-405e-bdf2-f055e0150d49',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 762.082346] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-3eee5457-701b-405e-bdf2-f055e0150d49 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.082346] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3eee5457-701b-405e-bdf2-f055e0150d49" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.082551] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock port-8f93c3af-9c27-410c-9e95-fc02f0e59041 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.082646] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8f93c3af-9c27-410c-9e95-fc02f0e59041" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.082838] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8f93c3af-9c27-410c-9e95-fc02f0e59041" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.083056] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8f93c3af-9c27-410c-9e95-fc02f0e59041" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.083170] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8f93c3af-9c27-410c-9e95-fc02f0e59041',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 762.583733] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-3eee5457-701b-405e-bdf2-f055e0150d49 taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.583733] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3eee5457-701b-405e-bdf2-f055e0150d49" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.586622] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8f93c3af-9c27-410c-9e95-fc02f0e59041 with status ACTIVE [ 762.586622] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.586622] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.586622] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.586622] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.586803] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.586951] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.587097] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.587163] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.587671] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.587671] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.587671] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.587833] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.587833] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.588446] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.588446] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.588446] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8f93c3af-9c27-410c-9e95-fc02f0e59041 is going to be updated. [ 762.614634] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.614849] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.614896] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.615210] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.615378] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.615665] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8f93c3af-9c27-410c-9e95-fc02f0e59041" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.878228] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 41ddc5e2-3eff-4217-8312-ffe238697b2c in Status: SUCCESS [ 762.878441] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-41ddc5e2-3eff-4217-8312-ffe238697b2c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.878607] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-41ddc5e2-3eff-4217-8312-ffe238697b2c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.878817] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-41ddc5e2-3eff-4217-8312-ffe238697b2c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.879035] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.879148] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.879210] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.879357] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.879433] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.879514] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-41ddc5e2-3eff-4217-8312-ffe238697b2c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.879603] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('41ddc5e2-3eff-4217-8312-ffe238697b2c',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 763.169124] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 934be6c8-f61f-4a11-9b02-e48c8e4ae509 in Status: SUCCESS [ 763.169492] env[65306]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 934be6c8-f61f-4a11-9b02-e48c8e4ae509 deletion is rescheduled due to dependency. [ 763.169492] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-934be6c8-f61f-4a11-9b02-e48c8e4ae509" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.340758] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 18bb45c8-7cab-44a5-887c-82deb65b8e26 in Status: SUCCESS [ 763.341269] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-18bb45c8-7cab-44a5-887c-82deb65b8e26" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.382912] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-41ddc5e2-3eff-4217-8312-ffe238697b2c taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.383185] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-41ddc5e2-3eff-4217-8312-ffe238697b2c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.383185] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-41ddc5e2-3eff-4217-8312-ffe238697b2c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.383425] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-41ddc5e2-3eff-4217-8312-ffe238697b2c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.383671] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.383755] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.383755] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.383951] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.384090] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.384209] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-41ddc5e2-3eff-4217-8312-ffe238697b2c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.384543] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-41ddc5e2-3eff-4217-8312-ffe238697b2c taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.384543] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-41ddc5e2-3eff-4217-8312-ffe238697b2c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.384666] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-41ddc5e2-3eff-4217-8312-ffe238697b2c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.384779] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-41ddc5e2-3eff-4217-8312-ffe238697b2c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.384947] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.385924] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.386016] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.386230] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.386363] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.386550] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-41ddc5e2-3eff-4217-8312-ffe238697b2c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.386685] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('41ddc5e2-3eff-4217-8312-ffe238697b2c',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 763.798549] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3eee5457-701b-405e-bdf2-f055e0150d49 in Status: SUCCESS [ 763.799153] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3eee5457-701b-405e-bdf2-f055e0150d49" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.799153] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3eee5457-701b-405e-bdf2-f055e0150d49" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.800062] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3eee5457-701b-405e-bdf2-f055e0150d49" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.800062] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.800062] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.800062] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.800062] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.800062] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.800062] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3eee5457-701b-405e-bdf2-f055e0150d49',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 763.890421] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 41ddc5e2-3eff-4217-8312-ffe238697b2c: rpc.has_security_group_logging(os_id): False [ 763.911865] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.912114] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.912114] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.912356] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.912466] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.912735] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.912852] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.912921] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.913101] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.913303] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.913377] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.913449] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.913505] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.913642] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.913717] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.913901] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.913993] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.918167] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.918351] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.918441] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.918544] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 41ddc5e2-3eff-4217-8312-ffe238697b2c is going to be created. [ 763.997128] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.997128] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.997313] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.997488] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.997684] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.029104] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 41ddc5e2-3eff-4217-8312-ffe238697b2c in Status: IN_PROGRESS for 2s [ 764.302851] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3eee5457-701b-405e-bdf2-f055e0150d49',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 764.807459] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3eee5457-701b-405e-bdf2-f055e0150d49',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 765.309886] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.310232] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.310369] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.310727] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.310727] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.310727] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3eee5457-701b-405e-bdf2-f055e0150d49 is going to be updated. [ 765.346035] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.346035] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.346271] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.347362] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.347362] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.363932] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3eee5457-701b-405e-bdf2-f055e0150d49 in Status: IN_PROGRESS for 2s [ 766.042539] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 41ddc5e2-3eff-4217-8312-ffe238697b2c in Status: SUCCESS [ 766.042810] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-41ddc5e2-3eff-4217-8312-ffe238697b2c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.503614] env[65306]: INFO networking_nsxv3.common.synchronization [None req-384f38ab-eb1f-4e94-9694-b224cd3c06b6 None None] Enqueued Resource ID: d8e58c4d-fe62-4b88-8b10-8a870fa4407f with Priority: HIGHEST for action port [ 766.504625] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d8e58c4d-fe62-4b88-8b10-8a870fa4407f with Priority: HIGHEST for action port [ 766.505042] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock port-d8e58c4d-fe62-4b88-8b10-8a870fa4407f taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.505913] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d8e58c4d-fe62-4b88-8b10-8a870fa4407f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.505913] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d8e58c4d-fe62-4b88-8b10-8a870fa4407f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.505913] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d8e58c4d-fe62-4b88-8b10-8a870fa4407f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.505913] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d8e58c4d-fe62-4b88-8b10-8a870fa4407f',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 766.655630] env[65306]: INFO networking_nsxv3.common.synchronization [req-db6bedfc-e567-4732-bc5c-bfb5e5395de2 req-41c3b95b-e621-4e30-ba96-3cd6a6a7ac70 tempest-ImagesTestJSON-762064805 tempest-ImagesTestJSON-762064805-project-member] Enqueued Resource ID: 57bb6fe9-98c4-47f0-9daa-c424a0c9dfee with Priority: HIGHEST for action security_group_members [ 766.657019] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 57bb6fe9-98c4-47f0-9daa-c424a0c9dfee with Priority: HIGHEST for action security_group_members [ 766.658316] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-57bb6fe9-98c4-47f0-9daa-c424a0c9dfee taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.660377] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-57bb6fe9-98c4-47f0-9daa-c424a0c9dfee" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.660377] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-57bb6fe9-98c4-47f0-9daa-c424a0c9dfee" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.660377] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-57bb6fe9-98c4-47f0-9daa-c424a0c9dfee" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.660377] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.660377] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.660377] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.660377] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.660377] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.660377] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('57bb6fe9-98c4-47f0-9daa-c424a0c9dfee',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 767.011470] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d8e58c4d-fe62-4b88-8b10-8a870fa4407f [ 767.011555] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.011698] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.011789] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.012017] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.012133] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.012233] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d8e58c4d-fe62-4b88-8b10-8a870fa4407f already deleted. [ 767.012316] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d8e58c4d-fe62-4b88-8b10-8a870fa4407f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.164584] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.164584] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.164584] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.164584] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.164584] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.164792] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.164899] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.164986] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.165238] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.165309] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.165412] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 57bb6fe9-98c4-47f0-9daa-c424a0c9dfee already deleted. [ 767.165513] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-57bb6fe9-98c4-47f0-9daa-c424a0c9dfee" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.275545] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock network-873 taken with stack trace [, , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.275545] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "network-873" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.275545] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "network-873" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.275545] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "network-873" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.275545] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.275545] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.275545] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.275850] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.275883] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.276928] env[65306]: DEBUG dogpile.cache.region [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] No value present for key: 'zone-id' {{(pid=65306) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 767.276928] env[65306]: DEBUG dogpile.lock [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] NeedRegenerationException {{(pid=65306) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 767.276928] env[65306]: DEBUG dogpile.lock [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] no value, waiting for create lock {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 767.276928] env[65306]: DEBUG dogpile.lock [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] value creation lock acquired {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 767.276928] env[65306]: DEBUG dogpile.cache.region [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] No value present for key: 'zone-id' {{(pid=65306) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 767.276928] env[65306]: DEBUG dogpile.lock [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Calling creation function for not-yet-present value {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 767.276928] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 767.302496] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 767.302685] env[65306]: DEBUG dogpile.cache.region [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=65306) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 767.302818] env[65306]: DEBUG dogpile.lock [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Released creation lock {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 767.302996] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "network-873" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.303348] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock port-f4ec45cc-17b9-4d8d-95fd-a9efb3b2a942 taken with stack trace [, , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.303541] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "port-f4ec45cc-17b9-4d8d-95fd-a9efb3b2a942" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.303668] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "port-f4ec45cc-17b9-4d8d-95fd-a9efb3b2a942" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.304660] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "port-f4ec45cc-17b9-4d8d-95fd-a9efb3b2a942" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.304910] env[65306]: DEBUG networking_nsxv3.api.rpc [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f4ec45cc-17b9-4d8d-95fd-a9efb3b2a942',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 767.374960] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3eee5457-701b-405e-bdf2-f055e0150d49 in Status: SUCCESS [ 767.375981] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3eee5457-701b-405e-bdf2-f055e0150d49" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.376116] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3eee5457-701b-405e-bdf2-f055e0150d49" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.376506] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3eee5457-701b-405e-bdf2-f055e0150d49" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.376806] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.376965] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.377054] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.377437] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.377437] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.377547] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3eee5457-701b-405e-bdf2-f055e0150d49" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.377653] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3eee5457-701b-405e-bdf2-f055e0150d49',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 767.810564] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.810910] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.812552] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.812552] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.812552] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.812552] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Segment Port f4ec45cc-17b9-4d8d-95fd-a9efb3b2a942 not found, creating... [ 767.813945] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.813945] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.813945] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.813945] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.813945] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.813945] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.813945] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.814288] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.814288] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.814343] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.814576] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Resource: SegmentPort with ID: f4ec45cc-17b9-4d8d-95fd-a9efb3b2a942 is going to be created. [ 767.838111] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.838418] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.838582] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.838948] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.839263] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.840166] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "port-f4ec45cc-17b9-4d8d-95fd-a9efb3b2a942" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.879882] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-3eee5457-701b-405e-bdf2-f055e0150d49 taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.880132] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3eee5457-701b-405e-bdf2-f055e0150d49" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.880443] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3eee5457-701b-405e-bdf2-f055e0150d49" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.880486] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3eee5457-701b-405e-bdf2-f055e0150d49" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.880980] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.880980] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.880980] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.881146] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.881180] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.881252] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3eee5457-701b-405e-bdf2-f055e0150d49" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.881409] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-3eee5457-701b-405e-bdf2-f055e0150d49 taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.881511] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3eee5457-701b-405e-bdf2-f055e0150d49" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.881572] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3eee5457-701b-405e-bdf2-f055e0150d49" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.881727] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3eee5457-701b-405e-bdf2-f055e0150d49" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.881869] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.881975] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.882053] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.882699] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.883918] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.883918] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3eee5457-701b-405e-bdf2-f055e0150d49" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.883918] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3eee5457-701b-405e-bdf2-f055e0150d49',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 768.083809] env[65306]: INFO networking_nsxv3.common.synchronization [req-465ea3d0-5a42-4b52-bf16-ff2fd64eea3e req-80c7f6a3-5684-46b6-b890-bf1edf655782 tempest-ServersAdminNegativeTestJSON-1507119040 tempest-ServersAdminNegativeTestJSON-1507119040-project-member] Enqueued Resource ID: e3e0f6b2-2984-4938-adcc-0374a714ff76 with Priority: HIGHEST for action security_group_members [ 768.084394] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e3e0f6b2-2984-4938-adcc-0374a714ff76 with Priority: HIGHEST for action security_group_members [ 768.085122] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-e3e0f6b2-2984-4938-adcc-0374a714ff76 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.085122] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e3e0f6b2-2984-4938-adcc-0374a714ff76" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.085122] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e3e0f6b2-2984-4938-adcc-0374a714ff76" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.085399] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e3e0f6b2-2984-4938-adcc-0374a714ff76" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.085399] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.085399] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.085512] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.086630] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.086630] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.086630] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e3e0f6b2-2984-4938-adcc-0374a714ff76',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 768.387762] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3eee5457-701b-405e-bdf2-f055e0150d49: rpc.has_security_group_logging(os_id): False [ 768.407579] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.407922] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.407922] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.408145] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.408246] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.408495] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.408606] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.408690] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.408862] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.408943] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.409135] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.409234] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.409294] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.409484] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.409561] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.409710] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.409804] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.409867] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.410449] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.410582] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.410686] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3eee5457-701b-405e-bdf2-f055e0150d49 is going to be updated. [ 768.484727] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.485209] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.485381] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.485636] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.485839] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.507566] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3eee5457-701b-405e-bdf2-f055e0150d49 in Status: IN_PROGRESS for 2s [ 768.575352] env[65306]: INFO networking_nsxv3.common.synchronization [req-db6bedfc-e567-4732-bc5c-bfb5e5395de2 req-8ce78c68-b1fd-4732-96a1-b30763f4b1a0 service nova] Enqueued Resource ID: 57bb6fe9-98c4-47f0-9daa-c424a0c9dfee with Priority: HIGHEST for action security_group_rules [ 768.576209] env[65306]: INFO networking_nsxv3.common.synchronization [req-db6bedfc-e567-4732-bc5c-bfb5e5395de2 req-8ce78c68-b1fd-4732-96a1-b30763f4b1a0 service nova] Enqueued Resource ID: 57bb6fe9-98c4-47f0-9daa-c424a0c9dfee with Priority: HIGHEST for action security_group_members [ 768.577065] env[65306]: INFO networking_nsxv3.common.synchronization [req-db6bedfc-e567-4732-bc5c-bfb5e5395de2 req-8ce78c68-b1fd-4732-96a1-b30763f4b1a0 service nova] Enqueued Resource ID: f4ec45cc-17b9-4d8d-95fd-a9efb3b2a942 with Priority: HIGHEST for action port [ 768.578062] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 57bb6fe9-98c4-47f0-9daa-c424a0c9dfee with Priority: HIGHEST for action security_group_rules [ 768.578062] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 57bb6fe9-98c4-47f0-9daa-c424a0c9dfee with Priority: HIGHEST for action security_group_members [ 768.578220] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f4ec45cc-17b9-4d8d-95fd-a9efb3b2a942 with Priority: HIGHEST for action port [ 768.578522] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock rules-57bb6fe9-98c4-47f0-9daa-c424a0c9dfee taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.578660] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-57bb6fe9-98c4-47f0-9daa-c424a0c9dfee" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.578731] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-57bb6fe9-98c4-47f0-9daa-c424a0c9dfee" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.579019] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-57bb6fe9-98c4-47f0-9daa-c424a0c9dfee" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.579124] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('57bb6fe9-98c4-47f0-9daa-c424a0c9dfee',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 768.580286] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-57bb6fe9-98c4-47f0-9daa-c424a0c9dfee taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.580373] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-57bb6fe9-98c4-47f0-9daa-c424a0c9dfee" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.580424] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-57bb6fe9-98c4-47f0-9daa-c424a0c9dfee" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.580602] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-57bb6fe9-98c4-47f0-9daa-c424a0c9dfee" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.580808] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.580887] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.580951] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.581109] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.581211] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.581384] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('57bb6fe9-98c4-47f0-9daa-c424a0c9dfee',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 768.582501] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock port-f4ec45cc-17b9-4d8d-95fd-a9efb3b2a942 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.582501] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f4ec45cc-17b9-4d8d-95fd-a9efb3b2a942" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.582501] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f4ec45cc-17b9-4d8d-95fd-a9efb3b2a942" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.585430] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f4ec45cc-17b9-4d8d-95fd-a9efb3b2a942" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.589270] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f4ec45cc-17b9-4d8d-95fd-a9efb3b2a942',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 768.589270] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.589270] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.589270] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.589270] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.589270] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.589270] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.589270] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.589270] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.589637] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.589637] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.589637] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e3e0f6b2-2984-4938-adcc-0374a714ff76 is going to be updated. [ 768.641910] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.642270] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.642361] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.642602] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.642758] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.654296] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e3e0f6b2-2984-4938-adcc-0374a714ff76 in Status: IN_PROGRESS for 2s [ 768.754975] env[65306]: INFO networking_nsxv3.common.synchronization [None req-5355337e-f285-4518-96ee-377ec6ab1338 None None] Enqueued Resource ID: 15161fbe-bf7f-402d-9942-201f2a8dcfd7 with Priority: HIGHEST for action port [ 768.754975] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 15161fbe-bf7f-402d-9942-201f2a8dcfd7 with Priority: HIGHEST for action port [ 768.755358] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock port-15161fbe-bf7f-402d-9942-201f2a8dcfd7 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.755358] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-15161fbe-bf7f-402d-9942-201f2a8dcfd7" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.755489] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-15161fbe-bf7f-402d-9942-201f2a8dcfd7" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.755955] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-15161fbe-bf7f-402d-9942-201f2a8dcfd7" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.756090] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('15161fbe-bf7f-402d-9942-201f2a8dcfd7',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 769.089282] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('57bb6fe9-98c4-47f0-9daa-c424a0c9dfee',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 769.092282] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-57bb6fe9-98c4-47f0-9daa-c424a0c9dfee taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.092453] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-57bb6fe9-98c4-47f0-9daa-c424a0c9dfee" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.093120] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f4ec45cc-17b9-4d8d-95fd-a9efb3b2a942 with status ACTIVE [ 769.093388] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.093523] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.093586] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.093792] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.093886] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.094068] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.094359] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.094359] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.094575] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.094714] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.096111] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.096111] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.096111] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.096111] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.096111] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.096111] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f4ec45cc-17b9-4d8d-95fd-a9efb3b2a942 is going to be updated. [ 769.122472] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.122818] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.122818] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.123077] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.123145] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.123414] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f4ec45cc-17b9-4d8d-95fd-a9efb3b2a942" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.260986] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 15161fbe-bf7f-402d-9942-201f2a8dcfd7 [ 769.260986] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.260986] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.260986] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.260986] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.260986] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.260986] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:15161fbe-bf7f-402d-9942-201f2a8dcfd7 already deleted. [ 769.260986] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-15161fbe-bf7f-402d-9942-201f2a8dcfd7" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.282028] env[65306]: INFO networking_nsxv3.common.synchronization [req-017a17a6-fcc9-413a-a723-a6696209c776 req-0a0cf17f-401c-4a4c-8aa2-339f55e90b90 tempest-MigrationsAdminTest-1842265666 tempest-MigrationsAdminTest-1842265666-project-member] Enqueued Resource ID: 8beaaac6-ba63-44e8-a960-7e228e2e7d37 with Priority: HIGHEST for action security_group_members [ 769.282028] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8beaaac6-ba63-44e8-a960-7e228e2e7d37 with Priority: HIGHEST for action security_group_members [ 769.282028] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-8beaaac6-ba63-44e8-a960-7e228e2e7d37 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.282028] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8beaaac6-ba63-44e8-a960-7e228e2e7d37" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.282028] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8beaaac6-ba63-44e8-a960-7e228e2e7d37" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.282567] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8beaaac6-ba63-44e8-a960-7e228e2e7d37" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.282885] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.283184] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.283369] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.283674] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.283887] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.284121] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8beaaac6-ba63-44e8-a960-7e228e2e7d37',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 769.594661] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('57bb6fe9-98c4-47f0-9daa-c424a0c9dfee',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 769.711245] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock network-707 taken with stack trace [, , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.711245] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "network-707" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.711245] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "network-707" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.711245] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "network-707" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.711245] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.711245] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.711245] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.711910] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.712578] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.713369] env[65306]: DEBUG dogpile.cache.region [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] No value present for key: 'zone-id' {{(pid=65306) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 769.713656] env[65306]: DEBUG dogpile.lock [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] NeedRegenerationException {{(pid=65306) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 769.714277] env[65306]: DEBUG dogpile.lock [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] no value, waiting for create lock {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 769.716427] env[65306]: DEBUG dogpile.lock [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] value creation lock acquired {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 769.716427] env[65306]: DEBUG dogpile.cache.region [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] No value present for key: 'zone-id' {{(pid=65306) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 769.716427] env[65306]: DEBUG dogpile.lock [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Calling creation function for not-yet-present value {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 769.716427] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 769.736054] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 769.736614] env[65306]: DEBUG dogpile.cache.region [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65306) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 769.737120] env[65306]: DEBUG dogpile.lock [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Released creation lock {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 769.737548] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "network-707" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.740524] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock port-d7084695-e621-417f-bbb1-be4202fca4d7 taken with stack trace [, , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.740524] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "port-d7084695-e621-417f-bbb1-be4202fca4d7" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.740524] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "port-d7084695-e621-417f-bbb1-be4202fca4d7" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.740524] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "port-d7084695-e621-417f-bbb1-be4202fca4d7" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.740524] env[65306]: DEBUG networking_nsxv3.api.rpc [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d7084695-e621-417f-bbb1-be4202fca4d7',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 769.786695] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8beaaac6-ba63-44e8-a960-7e228e2e7d37',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 770.096659] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.097207] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.097207] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.097354] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.097782] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.097900] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 57bb6fe9-98c4-47f0-9daa-c424a0c9dfee is going to be created. [ 770.126903] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.127231] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.127231] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.127376] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.127521] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.139475] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 57bb6fe9-98c4-47f0-9daa-c424a0c9dfee in Status: UNINITIALIZED for 2s [ 770.243400] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.243613] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.243765] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.244156] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.244485] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.244567] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Segment Port d7084695-e621-417f-bbb1-be4202fca4d7 not found, creating... [ 770.244863] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.245063] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.245188] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.245507] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.245585] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.245859] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.246054] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.246188] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.246450] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.246596] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.246908] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Resource: SegmentPort with ID: d7084695-e621-417f-bbb1-be4202fca4d7 is going to be created. [ 770.271465] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.271652] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.272642] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.272642] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.272642] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.272642] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "port-d7084695-e621-417f-bbb1-be4202fca4d7" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.289444] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8beaaac6-ba63-44e8-a960-7e228e2e7d37',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 770.425683] env[65306]: INFO networking_nsxv3.common.synchronization [None req-49acc459-d6e6-47d6-9996-a79be24e3bd6 None None] Enqueued Resource ID: 7e0e1b19-c993-4b4e-a2f0-86cb5e4af67d with Priority: HIGHEST for action port [ 770.426379] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7e0e1b19-c993-4b4e-a2f0-86cb5e4af67d with Priority: HIGHEST for action port [ 770.426705] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock port-7e0e1b19-c993-4b4e-a2f0-86cb5e4af67d taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.426832] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7e0e1b19-c993-4b4e-a2f0-86cb5e4af67d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.426914] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7e0e1b19-c993-4b4e-a2f0-86cb5e4af67d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.429320] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7e0e1b19-c993-4b4e-a2f0-86cb5e4af67d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.429320] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7e0e1b19-c993-4b4e-a2f0-86cb5e4af67d',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 770.524034] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3eee5457-701b-405e-bdf2-f055e0150d49 in Status: SUCCESS [ 770.524172] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3eee5457-701b-405e-bdf2-f055e0150d49" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.664175] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e3e0f6b2-2984-4938-adcc-0374a714ff76 in Status: SUCCESS [ 770.664379] env[65306]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e3e0f6b2-2984-4938-adcc-0374a714ff76 deletion is rescheduled due to dependency. [ 770.664499] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e3e0f6b2-2984-4938-adcc-0374a714ff76" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.791579] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.791741] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.792120] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.792120] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.792120] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.792253] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8beaaac6-ba63-44e8-a960-7e228e2e7d37 is going to be updated. [ 770.849819] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.850047] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.850096] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.850313] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.850465] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.862199] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8beaaac6-ba63-44e8-a960-7e228e2e7d37 in Status: IN_PROGRESS for 2s [ 770.932498] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7e0e1b19-c993-4b4e-a2f0-86cb5e4af67d [ 770.932706] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.932790] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.932918] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.933120] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.933232] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.933333] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7e0e1b19-c993-4b4e-a2f0-86cb5e4af67d already deleted. [ 770.933417] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7e0e1b19-c993-4b4e-a2f0-86cb5e4af67d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.015254] env[65306]: INFO networking_nsxv3.common.synchronization [req-017a17a6-fcc9-413a-a723-a6696209c776 req-9c6f40e5-06d7-49a4-98f1-b41e10fa6a46 service nova] Enqueued Resource ID: 8beaaac6-ba63-44e8-a960-7e228e2e7d37 with Priority: HIGHEST for action security_group_rules [ 771.015254] env[65306]: INFO networking_nsxv3.common.synchronization [req-017a17a6-fcc9-413a-a723-a6696209c776 req-9c6f40e5-06d7-49a4-98f1-b41e10fa6a46 service nova] Enqueued Resource ID: 8beaaac6-ba63-44e8-a960-7e228e2e7d37 with Priority: HIGHEST for action security_group_members [ 771.015254] env[65306]: INFO networking_nsxv3.common.synchronization [req-017a17a6-fcc9-413a-a723-a6696209c776 req-9c6f40e5-06d7-49a4-98f1-b41e10fa6a46 service nova] Enqueued Resource ID: d7084695-e621-417f-bbb1-be4202fca4d7 with Priority: HIGHEST for action port [ 771.016036] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8beaaac6-ba63-44e8-a960-7e228e2e7d37 with Priority: HIGHEST for action security_group_rules [ 771.016036] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8beaaac6-ba63-44e8-a960-7e228e2e7d37 with Priority: HIGHEST for action security_group_members [ 771.016036] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d7084695-e621-417f-bbb1-be4202fca4d7 with Priority: HIGHEST for action port [ 771.016309] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8beaaac6-ba63-44e8-a960-7e228e2e7d37 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.016443] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8beaaac6-ba63-44e8-a960-7e228e2e7d37" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.016524] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8beaaac6-ba63-44e8-a960-7e228e2e7d37" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.016755] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8beaaac6-ba63-44e8-a960-7e228e2e7d37" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.016889] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8beaaac6-ba63-44e8-a960-7e228e2e7d37',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 771.018910] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-8beaaac6-ba63-44e8-a960-7e228e2e7d37 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.019081] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8beaaac6-ba63-44e8-a960-7e228e2e7d37" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.019325] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock port-d7084695-e621-417f-bbb1-be4202fca4d7 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.019500] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d7084695-e621-417f-bbb1-be4202fca4d7" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.019634] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d7084695-e621-417f-bbb1-be4202fca4d7" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.019849] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d7084695-e621-417f-bbb1-be4202fca4d7" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.019932] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d7084695-e621-417f-bbb1-be4202fca4d7',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 771.521701] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-8beaaac6-ba63-44e8-a960-7e228e2e7d37 taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.522081] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8beaaac6-ba63-44e8-a960-7e228e2e7d37" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.524243] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d7084695-e621-417f-bbb1-be4202fca4d7 with status ACTIVE [ 771.524620] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.524774] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.524841] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.525075] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.525172] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.525350] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.525447] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.525513] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.525698] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.525730] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.525920] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.525990] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.526080] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.526226] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.526297] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.526386] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d7084695-e621-417f-bbb1-be4202fca4d7 is going to be updated. [ 771.557325] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.557482] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.557663] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.557897] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.558075] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.558258] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d7084695-e621-417f-bbb1-be4202fca4d7" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.150373] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 57bb6fe9-98c4-47f0-9daa-c424a0c9dfee in Status: SUCCESS [ 772.150600] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-57bb6fe9-98c4-47f0-9daa-c424a0c9dfee" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.150775] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-57bb6fe9-98c4-47f0-9daa-c424a0c9dfee" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.151018] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-57bb6fe9-98c4-47f0-9daa-c424a0c9dfee" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.151218] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.151336] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.151400] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.151554] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.151635] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.151721] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-57bb6fe9-98c4-47f0-9daa-c424a0c9dfee" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.151811] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('57bb6fe9-98c4-47f0-9daa-c424a0c9dfee',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 772.580906] env[65306]: INFO networking_nsxv3.common.synchronization [None req-104ac212-5446-40ba-99bd-289f3e38807c None None] Enqueued Resource ID: c2686680-c57d-499f-8be8-0d84f54578ce with Priority: HIGHEST for action port [ 772.581984] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c2686680-c57d-499f-8be8-0d84f54578ce with Priority: HIGHEST for action port [ 772.581984] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock port-c2686680-c57d-499f-8be8-0d84f54578ce taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.581984] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c2686680-c57d-499f-8be8-0d84f54578ce" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.581984] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c2686680-c57d-499f-8be8-0d84f54578ce" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.582304] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c2686680-c57d-499f-8be8-0d84f54578ce" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.582304] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c2686680-c57d-499f-8be8-0d84f54578ce',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 772.654142] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-57bb6fe9-98c4-47f0-9daa-c424a0c9dfee taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.655401] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-57bb6fe9-98c4-47f0-9daa-c424a0c9dfee" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.655401] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-57bb6fe9-98c4-47f0-9daa-c424a0c9dfee" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.655401] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-57bb6fe9-98c4-47f0-9daa-c424a0c9dfee" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.655401] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.655401] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.655401] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.655739] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.655739] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.655739] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-57bb6fe9-98c4-47f0-9daa-c424a0c9dfee" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.656362] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-57bb6fe9-98c4-47f0-9daa-c424a0c9dfee taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.656362] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-57bb6fe9-98c4-47f0-9daa-c424a0c9dfee" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.656362] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-57bb6fe9-98c4-47f0-9daa-c424a0c9dfee" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.656362] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-57bb6fe9-98c4-47f0-9daa-c424a0c9dfee" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.656362] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.656631] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.656671] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.656908] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.656997] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.657133] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-57bb6fe9-98c4-47f0-9daa-c424a0c9dfee" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.657234] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('57bb6fe9-98c4-47f0-9daa-c424a0c9dfee',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 772.875129] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8beaaac6-ba63-44e8-a960-7e228e2e7d37 in Status: SUCCESS [ 772.878527] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8beaaac6-ba63-44e8-a960-7e228e2e7d37" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.878527] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8beaaac6-ba63-44e8-a960-7e228e2e7d37" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.878527] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8beaaac6-ba63-44e8-a960-7e228e2e7d37" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.878527] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.878527] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.878527] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.878527] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.878527] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.878527] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8beaaac6-ba63-44e8-a960-7e228e2e7d37',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 773.084471] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c2686680-c57d-499f-8be8-0d84f54578ce [ 773.084713] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.084842] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.084890] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.085144] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.085237] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.085375] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c2686680-c57d-499f-8be8-0d84f54578ce already deleted. [ 773.085454] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c2686680-c57d-499f-8be8-0d84f54578ce" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.161426] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 57bb6fe9-98c4-47f0-9daa-c424a0c9dfee: rpc.has_security_group_logging(os_id): False [ 773.183872] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.184129] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.184129] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.184842] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.184842] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.184842] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.184842] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.185113] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.185155] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.185294] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.185983] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.185983] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.186114] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.186221] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.186429] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.186509] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.186593] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.186655] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.186844] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.186923] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.187051] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 57bb6fe9-98c4-47f0-9daa-c424a0c9dfee is going to be created. [ 773.263361] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.263519] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.263590] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.263794] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.263972] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.274317] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 57bb6fe9-98c4-47f0-9daa-c424a0c9dfee in Status: IN_PROGRESS for 2s [ 773.381215] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8beaaac6-ba63-44e8-a960-7e228e2e7d37',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 773.854200] env[65306]: INFO networking_nsxv3.common.synchronization [req-f5acb6d3-3245-4457-a42a-a94d568f2e9e req-824030da-e754-4fce-8a51-311d8e1bd0b4 tempest-ServersTestMultiNic-959517935 tempest-ServersTestMultiNic-959517935-project-member] Enqueued Resource ID: f5174f7c-dc12-4dad-9284-eed34d64b830 with Priority: HIGHEST for action security_group_members [ 773.854817] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f5174f7c-dc12-4dad-9284-eed34d64b830 with Priority: HIGHEST for action security_group_members [ 773.861073] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-f5174f7c-dc12-4dad-9284-eed34d64b830 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.861073] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f5174f7c-dc12-4dad-9284-eed34d64b830" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.861073] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f5174f7c-dc12-4dad-9284-eed34d64b830" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.861073] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f5174f7c-dc12-4dad-9284-eed34d64b830" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.861073] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.861073] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.861073] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.861073] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.861073] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.861073] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f5174f7c-dc12-4dad-9284-eed34d64b830',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 773.883944] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8beaaac6-ba63-44e8-a960-7e228e2e7d37',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 774.196670] env[65306]: INFO networking_nsxv3.common.synchronization [req-f5acb6d3-3245-4457-a42a-a94d568f2e9e req-d2a04ce1-ae47-44fa-8e04-730ffbf135f6 tempest-ServersTestMultiNic-959517935 tempest-ServersTestMultiNic-959517935-project-member] Enqueued Resource ID: f5174f7c-dc12-4dad-9284-eed34d64b830 with Priority: HIGHEST for action security_group_members [ 774.197210] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f5174f7c-dc12-4dad-9284-eed34d64b830 with Priority: HIGHEST for action security_group_members [ 774.197513] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-f5174f7c-dc12-4dad-9284-eed34d64b830 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.197615] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f5174f7c-dc12-4dad-9284-eed34d64b830" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.363322] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.363506] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.363582] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.363802] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.363904] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.364234] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.364344] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.364411] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.364598] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.364681] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.364784] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f5174f7c-dc12-4dad-9284-eed34d64b830 is going to be updated. [ 774.389637] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.389798] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.389877] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.391302] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.391302] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.391302] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8beaaac6-ba63-44e8-a960-7e228e2e7d37 is going to be updated. [ 774.396013] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.396171] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.396238] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.396416] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.396554] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.405162] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f5174f7c-dc12-4dad-9284-eed34d64b830 in Status: IN_PROGRESS for 2s [ 774.420472] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.420652] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.420724] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.420930] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.421104] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.433248] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8beaaac6-ba63-44e8-a960-7e228e2e7d37 in Status: IN_PROGRESS for 2s [ 774.516030] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock network-994 taken with stack trace [, , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.516030] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "network-994" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.516030] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "network-994" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.516030] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "network-994" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.516030] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.516030] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.516030] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.516030] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.516030] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.516030] env[65306]: DEBUG dogpile.cache.region [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] No value present for key: 'zone-id' {{(pid=65306) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 774.516030] env[65306]: DEBUG dogpile.lock [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] NeedRegenerationException {{(pid=65306) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 774.516030] env[65306]: DEBUG dogpile.lock [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] no value, waiting for create lock {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 774.516030] env[65306]: DEBUG dogpile.lock [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] value creation lock acquired {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 774.516920] env[65306]: DEBUG dogpile.cache.region [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] No value present for key: 'zone-id' {{(pid=65306) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 774.516920] env[65306]: DEBUG dogpile.lock [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Calling creation function for not-yet-present value {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 774.516920] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 774.541028] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 774.541028] env[65306]: DEBUG dogpile.cache.region [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65306) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 774.541028] env[65306]: DEBUG dogpile.lock [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Released creation lock {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 774.541028] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "network-994" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.541028] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock port-10928340-d112-4cba-bf8b-f56c0517c465 taken with stack trace [, , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.541028] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "port-10928340-d112-4cba-bf8b-f56c0517c465" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.541028] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "port-10928340-d112-4cba-bf8b-f56c0517c465" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.541028] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "port-10928340-d112-4cba-bf8b-f56c0517c465" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.541028] env[65306]: DEBUG networking_nsxv3.api.rpc [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('10928340-d112-4cba-bf8b-f56c0517c465',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 775.046021] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.046021] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.046021] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.046021] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.046021] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.046021] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Segment Port 10928340-d112-4cba-bf8b-f56c0517c465 not found, creating... [ 775.046021] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.046021] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.046021] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.046021] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.046021] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.046672] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.046672] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.046672] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.046672] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.046672] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.047019] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Resource: SegmentPort with ID: 10928340-d112-4cba-bf8b-f56c0517c465 is going to be created. [ 775.067331] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.067806] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.068168] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.069317] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.069762] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.070141] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "port-10928340-d112-4cba-bf8b-f56c0517c465" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.122467] env[65306]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-fe90dfa9-7944-46fc-be94-0b3a151ba91d None None] NSXv3 Agent Agent loop - iteration:0 completed [ 775.122467] env[65306]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-fe90dfa9-7944-46fc-be94-0b3a151ba91d None None] NSXv3 Agent Agent loop - iteration:1 started [ 775.308124] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 57bb6fe9-98c4-47f0-9daa-c424a0c9dfee in Status: SUCCESS [ 775.308124] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-57bb6fe9-98c4-47f0-9daa-c424a0c9dfee" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.783854] env[65306]: INFO networking_nsxv3.common.synchronization [req-f5acb6d3-3245-4457-a42a-a94d568f2e9e req-20caf4e0-c882-46a6-b0f9-48d1642a34d7 service nova] Enqueued Resource ID: f5174f7c-dc12-4dad-9284-eed34d64b830 with Priority: HIGHEST for action security_group_rules [ 775.784018] env[65306]: INFO networking_nsxv3.common.synchronization [req-f5acb6d3-3245-4457-a42a-a94d568f2e9e req-20caf4e0-c882-46a6-b0f9-48d1642a34d7 service nova] Enqueued Resource ID: f5174f7c-dc12-4dad-9284-eed34d64b830 with Priority: HIGHEST for action security_group_members [ 775.784112] env[65306]: INFO networking_nsxv3.common.synchronization [req-f5acb6d3-3245-4457-a42a-a94d568f2e9e req-20caf4e0-c882-46a6-b0f9-48d1642a34d7 service nova] Enqueued Resource ID: 10928340-d112-4cba-bf8b-f56c0517c465 with Priority: HIGHEST for action port [ 775.784729] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f5174f7c-dc12-4dad-9284-eed34d64b830 with Priority: HIGHEST for action security_group_rules [ 775.784829] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f5174f7c-dc12-4dad-9284-eed34d64b830 with Priority: HIGHEST for action security_group_members [ 775.785566] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 10928340-d112-4cba-bf8b-f56c0517c465 with Priority: HIGHEST for action port [ 775.785566] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f5174f7c-dc12-4dad-9284-eed34d64b830 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.785566] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f5174f7c-dc12-4dad-9284-eed34d64b830" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.785566] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f5174f7c-dc12-4dad-9284-eed34d64b830" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.785912] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f5174f7c-dc12-4dad-9284-eed34d64b830" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.785912] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f5174f7c-dc12-4dad-9284-eed34d64b830',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 775.786643] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-f5174f7c-dc12-4dad-9284-eed34d64b830 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.786742] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f5174f7c-dc12-4dad-9284-eed34d64b830" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.786921] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock port-10928340-d112-4cba-bf8b-f56c0517c465 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.787028] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-10928340-d112-4cba-bf8b-f56c0517c465" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.787127] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-10928340-d112-4cba-bf8b-f56c0517c465" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.787394] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-10928340-d112-4cba-bf8b-f56c0517c465" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.787479] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('10928340-d112-4cba-bf8b-f56c0517c465',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 776.289266] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-f5174f7c-dc12-4dad-9284-eed34d64b830 taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.289608] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f5174f7c-dc12-4dad-9284-eed34d64b830" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.289608] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 10928340-d112-4cba-bf8b-f56c0517c465 with status ACTIVE [ 776.290132] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.290132] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.290132] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.290720] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.290720] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.290720] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.290720] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.290898] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.290898] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.290986] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.291396] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.291396] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.291396] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.291527] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.291695] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.291695] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 10928340-d112-4cba-bf8b-f56c0517c465 is going to be updated. [ 776.315392] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.315392] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.315392] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.315392] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.315392] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.315392] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-10928340-d112-4cba-bf8b-f56c0517c465" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.418525] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f5174f7c-dc12-4dad-9284-eed34d64b830 in Status: SUCCESS [ 776.418719] env[65306]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f5174f7c-dc12-4dad-9284-eed34d64b830 deletion is rescheduled due to dependency. [ 776.418841] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f5174f7c-dc12-4dad-9284-eed34d64b830" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.419054] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f5174f7c-dc12-4dad-9284-eed34d64b830" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.419308] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f5174f7c-dc12-4dad-9284-eed34d64b830" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.419508] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.419641] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.419710] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.419876] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.419962] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.420094] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f5174f7c-dc12-4dad-9284-eed34d64b830',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 776.451785] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8beaaac6-ba63-44e8-a960-7e228e2e7d37 in Status: SUCCESS [ 776.452041] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8beaaac6-ba63-44e8-a960-7e228e2e7d37" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.452185] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8beaaac6-ba63-44e8-a960-7e228e2e7d37" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.452480] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8beaaac6-ba63-44e8-a960-7e228e2e7d37" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.452705] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.452961] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.452961] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.453086] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.453223] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.453313] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8beaaac6-ba63-44e8-a960-7e228e2e7d37" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.453616] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8beaaac6-ba63-44e8-a960-7e228e2e7d37',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 776.598213] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock network-961 taken with stack trace [, , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.598455] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "network-961" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.599227] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "network-961" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.599227] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "network-961" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.599588] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.599831] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.600083] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.600367] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.600516] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.600762] env[65306]: DEBUG dogpile.cache.region [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] No value present for key: 'zone-id' {{(pid=65306) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 776.600882] env[65306]: DEBUG dogpile.lock [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] NeedRegenerationException {{(pid=65306) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 776.600979] env[65306]: DEBUG dogpile.lock [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] no value, waiting for create lock {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 776.601099] env[65306]: DEBUG dogpile.lock [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] value creation lock acquired {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 776.601208] env[65306]: DEBUG dogpile.cache.region [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] No value present for key: 'zone-id' {{(pid=65306) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 776.601308] env[65306]: DEBUG dogpile.lock [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Calling creation function for not-yet-present value {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 776.601444] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 776.622013] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 776.622201] env[65306]: DEBUG dogpile.cache.region [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65306) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 776.622341] env[65306]: DEBUG dogpile.lock [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Released creation lock {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 776.622513] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "network-961" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.622920] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock port-fbed6276-da61-4608-832b-b2fa546f1930 taken with stack trace [, , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.623280] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "port-fbed6276-da61-4608-832b-b2fa546f1930" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.623389] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "port-fbed6276-da61-4608-832b-b2fa546f1930" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.623786] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "port-fbed6276-da61-4608-832b-b2fa546f1930" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.623942] env[65306]: DEBUG networking_nsxv3.api.rpc [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fbed6276-da61-4608-832b-b2fa546f1930',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 776.922185] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f5174f7c-dc12-4dad-9284-eed34d64b830',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 776.956466] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-8beaaac6-ba63-44e8-a960-7e228e2e7d37 taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.956665] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8beaaac6-ba63-44e8-a960-7e228e2e7d37" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.956713] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8beaaac6-ba63-44e8-a960-7e228e2e7d37" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.956987] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8beaaac6-ba63-44e8-a960-7e228e2e7d37" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.957219] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.957295] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.957426] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.957546] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.957641] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.957735] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8beaaac6-ba63-44e8-a960-7e228e2e7d37" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.957887] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-8beaaac6-ba63-44e8-a960-7e228e2e7d37 taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.958196] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8beaaac6-ba63-44e8-a960-7e228e2e7d37" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.958196] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8beaaac6-ba63-44e8-a960-7e228e2e7d37" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.958196] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8beaaac6-ba63-44e8-a960-7e228e2e7d37" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.958382] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.958453] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.958453] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.958591] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.958669] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.958754] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8beaaac6-ba63-44e8-a960-7e228e2e7d37" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.958837] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8beaaac6-ba63-44e8-a960-7e228e2e7d37',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 777.127458] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.127906] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.128117] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.128411] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.128562] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.128714] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Segment Port fbed6276-da61-4608-832b-b2fa546f1930 not found, creating... [ 777.128989] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.129243] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.129375] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.129597] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.129733] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.130050] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.130252] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.130380] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.130586] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.130715] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.130854] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Resource: SegmentPort with ID: fbed6276-da61-4608-832b-b2fa546f1930 is going to be created. [ 777.151188] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.151402] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.151520] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.151785] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.152016] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.152238] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "port-fbed6276-da61-4608-832b-b2fa546f1930" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.326475] env[65306]: INFO networking_nsxv3.common.synchronization [req-6ce2592b-6eb4-43a1-bc11-f45b486e0254 req-019eac26-13bc-406e-a631-5ef94e392766 tempest-ServerAddressesTestJSON-35391964 tempest-ServerAddressesTestJSON-35391964-project-member] Enqueued Resource ID: 5c095c1f-60f5-47d0-b270-e33f847ba33b with Priority: HIGHEST for action security_group_members [ 777.327224] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5c095c1f-60f5-47d0-b270-e33f847ba33b with Priority: HIGHEST for action security_group_members [ 777.327637] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-5c095c1f-60f5-47d0-b270-e33f847ba33b taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.327841] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5c095c1f-60f5-47d0-b270-e33f847ba33b" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.327964] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5c095c1f-60f5-47d0-b270-e33f847ba33b" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.328346] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5c095c1f-60f5-47d0-b270-e33f847ba33b" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.328620] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.328768] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.328901] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.329418] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.329418] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.329418] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5c095c1f-60f5-47d0-b270-e33f847ba33b',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 777.425316] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f5174f7c-dc12-4dad-9284-eed34d64b830',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 777.461137] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8beaaac6-ba63-44e8-a960-7e228e2e7d37: rpc.has_security_group_logging(os_id): False [ 777.497170] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.497170] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.497170] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.497170] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.497170] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.497170] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.497170] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.497170] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.497170] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.497170] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.497170] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.497789] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.497789] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.497789] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.497789] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.497789] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.498024] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.498024] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.498094] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.498122] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.498484] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8beaaac6-ba63-44e8-a960-7e228e2e7d37 is going to be updated. [ 777.579516] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.579674] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.579719] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.579922] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.580123] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.595871] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8beaaac6-ba63-44e8-a960-7e228e2e7d37 in Status: IN_PROGRESS for 2s [ 777.782156] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock network-701 taken with stack trace [, , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.782422] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "network-701" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.782422] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "network-701" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.782664] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "network-701" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.783117] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.783117] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.783268] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.783460] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.783599] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.783798] env[65306]: DEBUG dogpile.cache.region [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] No value present for key: 'zone-id' {{(pid=65306) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 777.783906] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] NeedRegenerationException {{(pid=65306) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 777.784019] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] no value, waiting for create lock {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 777.784124] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] value creation lock acquired {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 777.784229] env[65306]: DEBUG dogpile.cache.region [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] No value present for key: 'zone-id' {{(pid=65306) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 777.784329] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Calling creation function for not-yet-present value {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 777.784455] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 777.803793] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 777.803900] env[65306]: DEBUG dogpile.cache.region [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=65306) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 777.804046] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Released creation lock {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 777.804283] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "network-701" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.804635] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock port-abd2ae09-86c2-4e1b-af36-d46fb71d712e taken with stack trace [, , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.804855] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "port-abd2ae09-86c2-4e1b-af36-d46fb71d712e" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.804998] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "port-abd2ae09-86c2-4e1b-af36-d46fb71d712e" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.805365] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "port-abd2ae09-86c2-4e1b-af36-d46fb71d712e" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.805542] env[65306]: DEBUG networking_nsxv3.api.rpc [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('abd2ae09-86c2-4e1b-af36-d46fb71d712e',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 777.832446] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.832651] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.832713] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.832948] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.833075] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.833336] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.833427] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.833464] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.833604] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.833678] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.833762] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5c095c1f-60f5-47d0-b270-e33f847ba33b already deleted. [ 777.833858] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5c095c1f-60f5-47d0-b270-e33f847ba33b" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.868113] env[65306]: INFO networking_nsxv3.common.synchronization [req-f5acb6d3-3245-4457-a42a-a94d568f2e9e req-e64c5c44-f10c-47e1-a5fe-e9230627a140 service nova] Enqueued Resource ID: f5174f7c-dc12-4dad-9284-eed34d64b830 with Priority: HIGHEST for action security_group_rules [ 777.868113] env[65306]: INFO networking_nsxv3.common.synchronization [req-f5acb6d3-3245-4457-a42a-a94d568f2e9e req-e64c5c44-f10c-47e1-a5fe-e9230627a140 service nova] Enqueued Resource ID: f5174f7c-dc12-4dad-9284-eed34d64b830 with Priority: HIGHEST for action security_group_members [ 777.868113] env[65306]: INFO networking_nsxv3.common.synchronization [req-f5acb6d3-3245-4457-a42a-a94d568f2e9e req-e64c5c44-f10c-47e1-a5fe-e9230627a140 service nova] Enqueued Resource ID: fbed6276-da61-4608-832b-b2fa546f1930 with Priority: HIGHEST for action port [ 777.868524] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f5174f7c-dc12-4dad-9284-eed34d64b830 with Priority: HIGHEST for action security_group_rules [ 777.868632] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f5174f7c-dc12-4dad-9284-eed34d64b830 with Priority: HIGHEST for action security_group_members [ 777.868778] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fbed6276-da61-4608-832b-b2fa546f1930 with Priority: HIGHEST for action port [ 777.869011] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f5174f7c-dc12-4dad-9284-eed34d64b830 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.869370] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f5174f7c-dc12-4dad-9284-eed34d64b830" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.869370] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-f5174f7c-dc12-4dad-9284-eed34d64b830 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.869482] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f5174f7c-dc12-4dad-9284-eed34d64b830" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.869636] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock port-fbed6276-da61-4608-832b-b2fa546f1930 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.869738] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fbed6276-da61-4608-832b-b2fa546f1930" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.869807] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fbed6276-da61-4608-832b-b2fa546f1930" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.869999] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fbed6276-da61-4608-832b-b2fa546f1930" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.870121] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fbed6276-da61-4608-832b-b2fa546f1930',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 777.927989] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.928233] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.928318] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.928784] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.928784] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.928784] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f5174f7c-dc12-4dad-9284-eed34d64b830 is going to be updated. [ 777.958679] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.958850] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.958925] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.959156] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.959318] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.969183] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f5174f7c-dc12-4dad-9284-eed34d64b830 in Status: IN_PROGRESS for 2s [ 778.312121] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.312466] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.312633] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.313152] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.313262] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.313388] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Segment Port abd2ae09-86c2-4e1b-af36-d46fb71d712e not found, creating... [ 778.313703] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.313918] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.314072] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.314361] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.314521] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.314833] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.314999] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.315366] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.315593] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.315746] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.315978] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Resource: SegmentPort with ID: abd2ae09-86c2-4e1b-af36-d46fb71d712e is going to be created. [ 778.341189] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.341563] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.341752] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.342179] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.342548] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.342886] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "port-abd2ae09-86c2-4e1b-af36-d46fb71d712e" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.375443] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port fbed6276-da61-4608-832b-b2fa546f1930 with status ACTIVE [ 778.375710] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.375868] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.375982] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.376223] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.376313] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.376460] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.376968] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.376968] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.376968] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.376968] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.377439] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.377439] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.377439] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.377624] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.377707] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.377801] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: fbed6276-da61-4608-832b-b2fa546f1930 is going to be updated. [ 778.403245] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.403397] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.403470] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.403682] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.403817] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.403975] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fbed6276-da61-4608-832b-b2fa546f1930" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.108499] env[65306]: INFO networking_nsxv3.common.synchronization [req-6ce2592b-6eb4-43a1-bc11-f45b486e0254 req-31d343be-c0c0-40a5-b7c9-c033cea6bc93 service nova] Enqueued Resource ID: 5c095c1f-60f5-47d0-b270-e33f847ba33b with Priority: HIGHEST for action security_group_rules [ 779.108499] env[65306]: INFO networking_nsxv3.common.synchronization [req-6ce2592b-6eb4-43a1-bc11-f45b486e0254 req-31d343be-c0c0-40a5-b7c9-c033cea6bc93 service nova] Enqueued Resource ID: 5c095c1f-60f5-47d0-b270-e33f847ba33b with Priority: HIGHEST for action security_group_members [ 779.108499] env[65306]: INFO networking_nsxv3.common.synchronization [req-6ce2592b-6eb4-43a1-bc11-f45b486e0254 req-31d343be-c0c0-40a5-b7c9-c033cea6bc93 service nova] Enqueued Resource ID: abd2ae09-86c2-4e1b-af36-d46fb71d712e with Priority: HIGHEST for action port [ 779.109088] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5c095c1f-60f5-47d0-b270-e33f847ba33b with Priority: HIGHEST for action security_group_rules [ 779.109294] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5c095c1f-60f5-47d0-b270-e33f847ba33b with Priority: HIGHEST for action security_group_members [ 779.109338] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: abd2ae09-86c2-4e1b-af36-d46fb71d712e with Priority: HIGHEST for action port [ 779.109635] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5c095c1f-60f5-47d0-b270-e33f847ba33b taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.109811] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5c095c1f-60f5-47d0-b270-e33f847ba33b" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.109893] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5c095c1f-60f5-47d0-b270-e33f847ba33b" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.111514] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5c095c1f-60f5-47d0-b270-e33f847ba33b" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.111693] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5c095c1f-60f5-47d0-b270-e33f847ba33b',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 779.112602] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-5c095c1f-60f5-47d0-b270-e33f847ba33b taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.113152] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5c095c1f-60f5-47d0-b270-e33f847ba33b" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.113225] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5c095c1f-60f5-47d0-b270-e33f847ba33b" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.113470] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5c095c1f-60f5-47d0-b270-e33f847ba33b" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.113560] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.113658] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.113719] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.115422] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.115422] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.115422] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5c095c1f-60f5-47d0-b270-e33f847ba33b',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 779.116592] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock port-abd2ae09-86c2-4e1b-af36-d46fb71d712e taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.116833] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-abd2ae09-86c2-4e1b-af36-d46fb71d712e" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.116833] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-abd2ae09-86c2-4e1b-af36-d46fb71d712e" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.116959] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-abd2ae09-86c2-4e1b-af36-d46fb71d712e" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.117124] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('abd2ae09-86c2-4e1b-af36-d46fb71d712e',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 779.616019] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8beaaac6-ba63-44e8-a960-7e228e2e7d37 in Status: SUCCESS [ 779.616342] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8beaaac6-ba63-44e8-a960-7e228e2e7d37" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.619182] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-5c095c1f-60f5-47d0-b270-e33f847ba33b taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.619256] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5c095c1f-60f5-47d0-b270-e33f847ba33b" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.619438] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5c095c1f-60f5-47d0-b270-e33f847ba33b',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 779.623296] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port abd2ae09-86c2-4e1b-af36-d46fb71d712e with status ACTIVE [ 779.623534] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.623664] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.623735] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.624233] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.624233] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.624461] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.624461] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.624461] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.624590] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.624698] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.624856] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.624989] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.624989] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.625265] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.625265] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.625265] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: abd2ae09-86c2-4e1b-af36-d46fb71d712e is going to be updated. [ 779.652734] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.652734] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.652734] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.652734] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.652734] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.652734] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-abd2ae09-86c2-4e1b-af36-d46fb71d712e" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.977964] env[65306]: INFO networking_nsxv3.common.synchronization [req-e5aaf246-5e39-4877-82ba-35f9f39a4c61 req-715fa344-372a-4fd6-b63c-8c8139fc2667 tempest-ServerDiskConfigTestJSON-771154958 tempest-ServerDiskConfigTestJSON-771154958-project-member] Enqueued Resource ID: 9e80329d-1fcd-4c50-8991-a90e2a1fbdbc with Priority: HIGHEST for action security_group_members [ 779.978735] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9e80329d-1fcd-4c50-8991-a90e2a1fbdbc with Priority: HIGHEST for action security_group_members [ 779.980205] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-9e80329d-1fcd-4c50-8991-a90e2a1fbdbc taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.980420] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9e80329d-1fcd-4c50-8991-a90e2a1fbdbc" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.980490] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9e80329d-1fcd-4c50-8991-a90e2a1fbdbc" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.980922] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9e80329d-1fcd-4c50-8991-a90e2a1fbdbc" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.980922] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.981106] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.981106] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.981289] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.981422] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.981585] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9e80329d-1fcd-4c50-8991-a90e2a1fbdbc',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 779.983682] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f5174f7c-dc12-4dad-9284-eed34d64b830 in Status: SUCCESS [ 779.985022] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f5174f7c-dc12-4dad-9284-eed34d64b830" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.986658] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f5174f7c-dc12-4dad-9284-eed34d64b830" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.986658] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f5174f7c-dc12-4dad-9284-eed34d64b830" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.986859] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.986968] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.987058] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.987208] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.987304] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.987755] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f5174f7c-dc12-4dad-9284-eed34d64b830',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 780.122667] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5c095c1f-60f5-47d0-b270-e33f847ba33b',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 780.405691] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock network-681 taken with stack trace [, , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.405970] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "network-681" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.406128] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "network-681" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.406559] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "network-681" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.406747] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.406905] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.407045] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.407279] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.407422] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.407621] env[65306]: DEBUG dogpile.cache.region [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] No value present for key: 'zone-id' {{(pid=65306) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 780.407737] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] NeedRegenerationException {{(pid=65306) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 780.407840] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] no value, waiting for create lock {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 780.407975] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] value creation lock acquired {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 780.408142] env[65306]: DEBUG dogpile.cache.region [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] No value present for key: 'zone-id' {{(pid=65306) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 780.408250] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Calling creation function for not-yet-present value {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 780.408384] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 780.430472] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 780.430622] env[65306]: DEBUG dogpile.cache.region [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65306) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 780.430764] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Released creation lock {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 780.431025] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "network-681" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.431353] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock port-3843aa28-2540-480c-a7e5-61026e7c4cbf taken with stack trace [, , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.431518] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "port-3843aa28-2540-480c-a7e5-61026e7c4cbf" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.431627] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "port-3843aa28-2540-480c-a7e5-61026e7c4cbf" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.432021] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "port-3843aa28-2540-480c-a7e5-61026e7c4cbf" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.432148] env[65306]: DEBUG networking_nsxv3.api.rpc [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3843aa28-2540-480c-a7e5-61026e7c4cbf',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 780.489488] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.489645] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.489738] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.489959] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.491152] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.491152] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.491152] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.491152] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.491152] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.491152] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.491152] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9e80329d-1fcd-4c50-8991-a90e2a1fbdbc already deleted. [ 780.491152] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9e80329d-1fcd-4c50-8991-a90e2a1fbdbc" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.491152] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f5174f7c-dc12-4dad-9284-eed34d64b830',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 780.625432] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.625432] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.625432] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.625432] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.625432] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.625432] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5c095c1f-60f5-47d0-b270-e33f847ba33b is going to be created. [ 780.657730] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.657730] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.657730] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.657730] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.657730] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.668394] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5c095c1f-60f5-47d0-b270-e33f847ba33b in Status: UNINITIALIZED for 2s [ 780.934766] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.935020] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.935105] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.935397] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.935548] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.935699] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Segment Port 3843aa28-2540-480c-a7e5-61026e7c4cbf not found, creating... [ 780.935952] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.936142] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.936230] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.936446] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.936577] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.936853] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.936994] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.937149] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.937373] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.937500] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.937633] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Resource: SegmentPort with ID: 3843aa28-2540-480c-a7e5-61026e7c4cbf is going to be created. [ 780.969237] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.969466] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.969627] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.969953] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.970338] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.970585] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "port-3843aa28-2540-480c-a7e5-61026e7c4cbf" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.993472] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f5174f7c-dc12-4dad-9284-eed34d64b830',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 781.496250] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.496465] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.496465] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.496935] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.497291] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.497430] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f5174f7c-dc12-4dad-9284-eed34d64b830 is going to be updated. [ 781.539600] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.539849] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.539947] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.540275] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.540920] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.553093] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f5174f7c-dc12-4dad-9284-eed34d64b830 in Status: IN_PROGRESS for 2s [ 781.688314] env[65306]: INFO networking_nsxv3.common.synchronization [req-e5aaf246-5e39-4877-82ba-35f9f39a4c61 req-53a8ff77-b10f-456c-99eb-973da4a9b83f service nova] Enqueued Resource ID: 9e80329d-1fcd-4c50-8991-a90e2a1fbdbc with Priority: HIGHEST for action security_group_rules [ 781.688737] env[65306]: INFO networking_nsxv3.common.synchronization [req-e5aaf246-5e39-4877-82ba-35f9f39a4c61 req-53a8ff77-b10f-456c-99eb-973da4a9b83f service nova] Enqueued Resource ID: 9e80329d-1fcd-4c50-8991-a90e2a1fbdbc with Priority: HIGHEST for action security_group_members [ 781.688737] env[65306]: INFO networking_nsxv3.common.synchronization [req-e5aaf246-5e39-4877-82ba-35f9f39a4c61 req-53a8ff77-b10f-456c-99eb-973da4a9b83f service nova] Enqueued Resource ID: 3843aa28-2540-480c-a7e5-61026e7c4cbf with Priority: HIGHEST for action port [ 781.689105] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9e80329d-1fcd-4c50-8991-a90e2a1fbdbc with Priority: HIGHEST for action security_group_rules [ 781.689244] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9e80329d-1fcd-4c50-8991-a90e2a1fbdbc with Priority: HIGHEST for action security_group_members [ 781.689342] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3843aa28-2540-480c-a7e5-61026e7c4cbf with Priority: HIGHEST for action port [ 781.689621] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9e80329d-1fcd-4c50-8991-a90e2a1fbdbc taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.689740] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9e80329d-1fcd-4c50-8991-a90e2a1fbdbc" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.689807] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9e80329d-1fcd-4c50-8991-a90e2a1fbdbc" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.690273] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9e80329d-1fcd-4c50-8991-a90e2a1fbdbc" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.690344] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9e80329d-1fcd-4c50-8991-a90e2a1fbdbc',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 781.691564] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-9e80329d-1fcd-4c50-8991-a90e2a1fbdbc taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.691733] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9e80329d-1fcd-4c50-8991-a90e2a1fbdbc" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.691803] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9e80329d-1fcd-4c50-8991-a90e2a1fbdbc" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.691981] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9e80329d-1fcd-4c50-8991-a90e2a1fbdbc" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.692143] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.692231] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.692292] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.692434] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.692637] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.692637] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9e80329d-1fcd-4c50-8991-a90e2a1fbdbc',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 781.693636] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock port-3843aa28-2540-480c-a7e5-61026e7c4cbf taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.693720] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3843aa28-2540-480c-a7e5-61026e7c4cbf" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.693849] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3843aa28-2540-480c-a7e5-61026e7c4cbf" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.694029] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3843aa28-2540-480c-a7e5-61026e7c4cbf" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.694108] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3843aa28-2540-480c-a7e5-61026e7c4cbf',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 782.192295] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-9e80329d-1fcd-4c50-8991-a90e2a1fbdbc taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.192507] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9e80329d-1fcd-4c50-8991-a90e2a1fbdbc" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.196032] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9e80329d-1fcd-4c50-8991-a90e2a1fbdbc',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 782.198153] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3843aa28-2540-480c-a7e5-61026e7c4cbf with status ACTIVE [ 782.198606] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.198811] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.198869] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.199273] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.199359] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.199718] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.200118] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.200237] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.200469] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.200575] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.200795] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.200896] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.200972] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.201161] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.201247] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.201361] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3843aa28-2540-480c-a7e5-61026e7c4cbf is going to be updated. [ 782.226966] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.227233] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.227327] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.227546] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.227683] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.227895] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3843aa28-2540-480c-a7e5-61026e7c4cbf" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.680705] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5c095c1f-60f5-47d0-b270-e33f847ba33b in Status: SUCCESS [ 782.685775] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5c095c1f-60f5-47d0-b270-e33f847ba33b" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.685775] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5c095c1f-60f5-47d0-b270-e33f847ba33b" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.685775] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5c095c1f-60f5-47d0-b270-e33f847ba33b" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.685775] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.685775] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.685775] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.685775] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.685775] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.685775] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5c095c1f-60f5-47d0-b270-e33f847ba33b" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.685775] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5c095c1f-60f5-47d0-b270-e33f847ba33b',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 782.700497] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9e80329d-1fcd-4c50-8991-a90e2a1fbdbc',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 782.724321] env[65306]: INFO networking_nsxv3.common.synchronization [req-de63851c-5257-4529-ac66-b61754640848 req-f05b4d21-dca2-454d-b7f4-cfa0d9e5358e tempest-InstanceActionsTestJSON-1096187469 tempest-InstanceActionsTestJSON-1096187469-project-member] Enqueued Resource ID: c3a4b03d-2231-4b42-a522-be404c2784e5 with Priority: HIGHEST for action security_group_members [ 782.725917] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c3a4b03d-2231-4b42-a522-be404c2784e5 with Priority: HIGHEST for action security_group_members [ 782.726186] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-c3a4b03d-2231-4b42-a522-be404c2784e5 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.726304] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c3a4b03d-2231-4b42-a522-be404c2784e5" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.726375] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c3a4b03d-2231-4b42-a522-be404c2784e5" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.726624] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c3a4b03d-2231-4b42-a522-be404c2784e5" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.726820] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.726890] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.726922] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.727148] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.727219] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.727381] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c3a4b03d-2231-4b42-a522-be404c2784e5',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 783.151721] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock network-89 taken with stack trace [, , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.152023] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "network-89" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.152349] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "network-89" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.152993] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "network-89" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.153306] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.153572] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.153754] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.154145] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.154268] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.154559] env[65306]: DEBUG dogpile.cache.region [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] No value present for key: 'zone-id' {{(pid=65306) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 783.154731] env[65306]: DEBUG dogpile.lock [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] NeedRegenerationException {{(pid=65306) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 783.154883] env[65306]: DEBUG dogpile.lock [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] no value, waiting for create lock {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 783.155055] env[65306]: DEBUG dogpile.lock [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] value creation lock acquired {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 783.155231] env[65306]: DEBUG dogpile.cache.region [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] No value present for key: 'zone-id' {{(pid=65306) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 783.155494] env[65306]: DEBUG dogpile.lock [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Calling creation function for not-yet-present value {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 783.155580] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 783.177871] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 783.178173] env[65306]: DEBUG dogpile.cache.region [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65306) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 783.178355] env[65306]: DEBUG dogpile.lock [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Released creation lock {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 783.178581] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "network-89" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.179020] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock port-62f1e581-96cb-4a8a-8fc4-0afd07728354 taken with stack trace [, , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.179271] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "port-62f1e581-96cb-4a8a-8fc4-0afd07728354" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.179453] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "port-62f1e581-96cb-4a8a-8fc4-0afd07728354" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.179911] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "port-62f1e581-96cb-4a8a-8fc4-0afd07728354" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.180168] env[65306]: DEBUG networking_nsxv3.api.rpc [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('62f1e581-96cb-4a8a-8fc4-0afd07728354',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 783.188959] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-5c095c1f-60f5-47d0-b270-e33f847ba33b taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.189196] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5c095c1f-60f5-47d0-b270-e33f847ba33b" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.189322] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5c095c1f-60f5-47d0-b270-e33f847ba33b" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.189591] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5c095c1f-60f5-47d0-b270-e33f847ba33b" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.189827] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.189970] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.190133] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.190359] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.190572] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.190731] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5c095c1f-60f5-47d0-b270-e33f847ba33b" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.190956] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-5c095c1f-60f5-47d0-b270-e33f847ba33b taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.191104] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5c095c1f-60f5-47d0-b270-e33f847ba33b" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.191201] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5c095c1f-60f5-47d0-b270-e33f847ba33b" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.191402] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5c095c1f-60f5-47d0-b270-e33f847ba33b" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.191697] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.191849] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.191938] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.192275] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.192275] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.193040] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5c095c1f-60f5-47d0-b270-e33f847ba33b" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.193040] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5c095c1f-60f5-47d0-b270-e33f847ba33b',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 783.201542] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.201725] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.201835] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.203218] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.203389] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.203531] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9e80329d-1fcd-4c50-8991-a90e2a1fbdbc is going to be created. [ 783.230017] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.230260] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.230399] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.230544] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.230634] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.230866] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.230978] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.231440] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.231629] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.231715] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.231807] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c3a4b03d-2231-4b42-a522-be404c2784e5 already deleted. [ 783.231894] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c3a4b03d-2231-4b42-a522-be404c2784e5" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.236123] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.236313] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.236430] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.236638] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.236846] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.246966] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9e80329d-1fcd-4c50-8991-a90e2a1fbdbc in Status: UNINITIALIZED for 2s [ 783.564132] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f5174f7c-dc12-4dad-9284-eed34d64b830 in Status: SUCCESS [ 783.564393] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f5174f7c-dc12-4dad-9284-eed34d64b830" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.564603] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f5174f7c-dc12-4dad-9284-eed34d64b830" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.564877] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f5174f7c-dc12-4dad-9284-eed34d64b830" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.565095] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.565219] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.565309] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.565487] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.565557] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.565644] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f5174f7c-dc12-4dad-9284-eed34d64b830" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.565752] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f5174f7c-dc12-4dad-9284-eed34d64b830',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 783.566665] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f5174f7c-dc12-4dad-9284-eed34d64b830" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.566794] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f5174f7c-dc12-4dad-9284-eed34d64b830" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.566959] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.567075] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.567143] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.567286] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.567390] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.567488] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f5174f7c-dc12-4dad-9284-eed34d64b830',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 783.682771] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.683059] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.683195] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.683540] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.683755] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.683956] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Segment Port 62f1e581-96cb-4a8a-8fc4-0afd07728354 not found, creating... [ 783.684349] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.684587] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.684713] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.685036] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.685224] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.685603] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.685777] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.685952] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.686235] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.686443] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.686630] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Resource: SegmentPort with ID: 62f1e581-96cb-4a8a-8fc4-0afd07728354 is going to be created. [ 783.695661] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5c095c1f-60f5-47d0-b270-e33f847ba33b: rpc.has_security_group_logging(os_id): False [ 783.713840] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.714140] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.714412] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.714765] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.715037] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.715296] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "port-62f1e581-96cb-4a8a-8fc4-0afd07728354" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.716824] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.716947] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.717070] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.717206] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.717288] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.717489] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.717589] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.717649] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.717822] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.717899] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.718160] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.718280] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.718350] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.718496] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.718567] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.718759] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.718846] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.718909] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.719327] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.719327] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.719327] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5c095c1f-60f5-47d0-b270-e33f847ba33b is going to be created. [ 783.793025] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.793293] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.793437] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.793698] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.794069] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.811105] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5c095c1f-60f5-47d0-b270-e33f847ba33b in Status: IN_PROGRESS for 2s [ 784.070046] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-f5174f7c-dc12-4dad-9284-eed34d64b830 taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.070338] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f5174f7c-dc12-4dad-9284-eed34d64b830" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.073961] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f5174f7c-dc12-4dad-9284-eed34d64b830',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 784.449649] env[65306]: INFO networking_nsxv3.common.synchronization [req-de63851c-5257-4529-ac66-b61754640848 req-3a768c16-af27-4008-b366-08225265dc3f service nova] Enqueued Resource ID: c3a4b03d-2231-4b42-a522-be404c2784e5 with Priority: HIGHEST for action security_group_rules [ 784.449649] env[65306]: INFO networking_nsxv3.common.synchronization [req-de63851c-5257-4529-ac66-b61754640848 req-3a768c16-af27-4008-b366-08225265dc3f service nova] Enqueued Resource ID: c3a4b03d-2231-4b42-a522-be404c2784e5 with Priority: HIGHEST for action security_group_members [ 784.449649] env[65306]: INFO networking_nsxv3.common.synchronization [req-de63851c-5257-4529-ac66-b61754640848 req-3a768c16-af27-4008-b366-08225265dc3f service nova] Enqueued Resource ID: 62f1e581-96cb-4a8a-8fc4-0afd07728354 with Priority: HIGHEST for action port [ 784.449933] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c3a4b03d-2231-4b42-a522-be404c2784e5 with Priority: HIGHEST for action security_group_rules [ 784.452395] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c3a4b03d-2231-4b42-a522-be404c2784e5 with Priority: HIGHEST for action security_group_members [ 784.452395] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 62f1e581-96cb-4a8a-8fc4-0afd07728354 with Priority: HIGHEST for action port [ 784.452395] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c3a4b03d-2231-4b42-a522-be404c2784e5 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.452395] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c3a4b03d-2231-4b42-a522-be404c2784e5" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.452395] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c3a4b03d-2231-4b42-a522-be404c2784e5" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.452395] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c3a4b03d-2231-4b42-a522-be404c2784e5" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.452395] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c3a4b03d-2231-4b42-a522-be404c2784e5',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 784.453324] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-c3a4b03d-2231-4b42-a522-be404c2784e5 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.454845] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c3a4b03d-2231-4b42-a522-be404c2784e5" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.455018] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c3a4b03d-2231-4b42-a522-be404c2784e5" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.455326] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c3a4b03d-2231-4b42-a522-be404c2784e5" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.456450] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.456772] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.457028] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.460027] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.460027] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.460027] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c3a4b03d-2231-4b42-a522-be404c2784e5',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 784.460027] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock port-62f1e581-96cb-4a8a-8fc4-0afd07728354 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.460027] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-62f1e581-96cb-4a8a-8fc4-0afd07728354" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.460027] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-62f1e581-96cb-4a8a-8fc4-0afd07728354" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.460027] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-62f1e581-96cb-4a8a-8fc4-0afd07728354" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.460027] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('62f1e581-96cb-4a8a-8fc4-0afd07728354',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 784.576315] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f5174f7c-dc12-4dad-9284-eed34d64b830',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 784.963026] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c3a4b03d-2231-4b42-a522-be404c2784e5',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 784.965462] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-c3a4b03d-2231-4b42-a522-be404c2784e5 taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.966407] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c3a4b03d-2231-4b42-a522-be404c2784e5" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.966407] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 62f1e581-96cb-4a8a-8fc4-0afd07728354 with status ACTIVE [ 784.966407] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.966651] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.966651] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.968221] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.968221] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.968221] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.968221] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.968221] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.968221] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.968491] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.969222] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.969222] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.969222] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.969417] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.969417] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.969573] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 62f1e581-96cb-4a8a-8fc4-0afd07728354 is going to be updated. [ 784.997155] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.997382] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.997479] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.998333] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.998574] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.998875] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-62f1e581-96cb-4a8a-8fc4-0afd07728354" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.079691] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.079892] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.079944] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.080223] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.080338] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.080493] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f5174f7c-dc12-4dad-9284-eed34d64b830 is going to be updated. [ 785.124650] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.124815] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.124926] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.125109] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.125259] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.139167] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f5174f7c-dc12-4dad-9284-eed34d64b830 in Status: IN_PROGRESS for 2s [ 785.259491] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9e80329d-1fcd-4c50-8991-a90e2a1fbdbc in Status: SUCCESS [ 785.259491] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9e80329d-1fcd-4c50-8991-a90e2a1fbdbc" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.259491] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9e80329d-1fcd-4c50-8991-a90e2a1fbdbc" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.259491] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9e80329d-1fcd-4c50-8991-a90e2a1fbdbc" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.259865] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.259865] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.259865] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.259865] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.260021] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.260123] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9e80329d-1fcd-4c50-8991-a90e2a1fbdbc" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.260189] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9e80329d-1fcd-4c50-8991-a90e2a1fbdbc',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.436065] env[65306]: INFO networking_nsxv3.common.synchronization [req-4ddc74a1-5d6d-4c25-ba43-3f3cf37daa5b req-b92405cd-2fab-4859-90ee-4ee551bae5b9 tempest-FloatingIPsAssociationTestJSON-1677333687 tempest-FloatingIPsAssociationTestJSON-1677333687-project-member] Enqueued Resource ID: 3eee5457-701b-405e-bdf2-f055e0150d49 with Priority: HIGHEST for action security_group_members [ 785.437029] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3eee5457-701b-405e-bdf2-f055e0150d49 with Priority: HIGHEST for action security_group_members [ 785.437364] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-3eee5457-701b-405e-bdf2-f055e0150d49 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.437913] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3eee5457-701b-405e-bdf2-f055e0150d49" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.438687] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3eee5457-701b-405e-bdf2-f055e0150d49" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.439054] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3eee5457-701b-405e-bdf2-f055e0150d49" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.439618] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.439819] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.440096] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.440356] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.440518] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.440688] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3eee5457-701b-405e-bdf2-f055e0150d49',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.472606] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c3a4b03d-2231-4b42-a522-be404c2784e5',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.763466] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-9e80329d-1fcd-4c50-8991-a90e2a1fbdbc taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.763626] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9e80329d-1fcd-4c50-8991-a90e2a1fbdbc" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.764772] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9e80329d-1fcd-4c50-8991-a90e2a1fbdbc" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.764772] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9e80329d-1fcd-4c50-8991-a90e2a1fbdbc" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.764772] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.764772] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.764772] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.764772] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.764772] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.764772] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9e80329d-1fcd-4c50-8991-a90e2a1fbdbc" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.764772] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-9e80329d-1fcd-4c50-8991-a90e2a1fbdbc taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.764772] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9e80329d-1fcd-4c50-8991-a90e2a1fbdbc" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.765172] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9e80329d-1fcd-4c50-8991-a90e2a1fbdbc" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.765172] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9e80329d-1fcd-4c50-8991-a90e2a1fbdbc" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.765172] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.765271] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.765271] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.766275] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.766275] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.766275] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9e80329d-1fcd-4c50-8991-a90e2a1fbdbc" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.766275] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9e80329d-1fcd-4c50-8991-a90e2a1fbdbc',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.826532] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5c095c1f-60f5-47d0-b270-e33f847ba33b in Status: SUCCESS [ 785.826532] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5c095c1f-60f5-47d0-b270-e33f847ba33b" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.943784] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3eee5457-701b-405e-bdf2-f055e0150d49',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.979589] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.980109] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.980109] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.980109] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.980298] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.980376] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c3a4b03d-2231-4b42-a522-be404c2784e5 is going to be created. [ 786.016293] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.016483] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.016524] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.016733] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.016925] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.028605] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c3a4b03d-2231-4b42-a522-be404c2784e5 in Status: UNINITIALIZED for 2s [ 786.268386] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9e80329d-1fcd-4c50-8991-a90e2a1fbdbc: rpc.has_security_group_logging(os_id): False [ 786.291776] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.291942] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.292206] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.292535] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.292769] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.293845] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.294015] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.294114] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.295128] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.295254] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.295829] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.295829] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.295829] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.296021] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.296066] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.296290] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.296429] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.296516] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.296695] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.296805] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.296918] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9e80329d-1fcd-4c50-8991-a90e2a1fbdbc is going to be created. [ 786.395867] env[65306]: INFO networking_nsxv3.common.synchronization [req-b5c9bf7e-8a54-4f63-b18a-2104b96cc5f4 req-b70702e8-43d4-4aac-bea7-4d70549898e6 tempest-ServerRescueTestJSONUnderV235-1743615611 tempest-ServerRescueTestJSONUnderV235-1743615611-project-member] Enqueued Resource ID: 4a70577e-71a7-40b9-9b9e-1ced7534877d with Priority: HIGHEST for action security_group_members [ 786.396094] env[65306]: INFO networking_nsxv3.common.synchronization [req-b5c9bf7e-8a54-4f63-b18a-2104b96cc5f4 req-b70702e8-43d4-4aac-bea7-4d70549898e6 tempest-ServerRescueTestJSONUnderV235-1743615611 tempest-ServerRescueTestJSONUnderV235-1743615611-project-member] Enqueued Resource ID: 41ddc5e2-3eff-4217-8312-ffe238697b2c with Priority: HIGHEST for action security_group_members [ 786.396616] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4a70577e-71a7-40b9-9b9e-1ced7534877d with Priority: HIGHEST for action security_group_members [ 786.396757] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 41ddc5e2-3eff-4217-8312-ffe238697b2c with Priority: HIGHEST for action security_group_members [ 786.397060] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-4a70577e-71a7-40b9-9b9e-1ced7534877d taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.397341] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4a70577e-71a7-40b9-9b9e-1ced7534877d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.397341] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4a70577e-71a7-40b9-9b9e-1ced7534877d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.397521] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4a70577e-71a7-40b9-9b9e-1ced7534877d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.397684] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.397789] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.397856] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.398029] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.398391] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.398391] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4a70577e-71a7-40b9-9b9e-1ced7534877d',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.399977] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-41ddc5e2-3eff-4217-8312-ffe238697b2c taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.399977] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-41ddc5e2-3eff-4217-8312-ffe238697b2c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.399977] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-41ddc5e2-3eff-4217-8312-ffe238697b2c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.400268] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-41ddc5e2-3eff-4217-8312-ffe238697b2c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.400396] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.401207] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.401477] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.401689] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.401932] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.401932] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('41ddc5e2-3eff-4217-8312-ffe238697b2c',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.404487] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.404487] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.404487] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.404711] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.405280] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.427880] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9e80329d-1fcd-4c50-8991-a90e2a1fbdbc in Status: IN_PROGRESS for 2s [ 786.446658] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3eee5457-701b-405e-bdf2-f055e0150d49',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.453644] env[65306]: INFO networking_nsxv3.common.synchronization [req-b5c9bf7e-8a54-4f63-b18a-2104b96cc5f4 req-b70702e8-43d4-4aac-bea7-4d70549898e6 tempest-ServerRescueTestJSONUnderV235-1743615611 tempest-ServerRescueTestJSONUnderV235-1743615611-project-member] Enqueued Resource ID: 41ddc5e2-3eff-4217-8312-ffe238697b2c with Priority: HIGHEST for action security_group_rules [ 786.453849] env[65306]: INFO networking_nsxv3.common.synchronization [req-b5c9bf7e-8a54-4f63-b18a-2104b96cc5f4 req-b70702e8-43d4-4aac-bea7-4d70549898e6 tempest-ServerRescueTestJSONUnderV235-1743615611 tempest-ServerRescueTestJSONUnderV235-1743615611-project-member] Enqueued Resource ID: 41ddc5e2-3eff-4217-8312-ffe238697b2c with Priority: HIGHEST for action security_group_members [ 786.453992] env[65306]: INFO networking_nsxv3.common.synchronization [req-b5c9bf7e-8a54-4f63-b18a-2104b96cc5f4 req-b70702e8-43d4-4aac-bea7-4d70549898e6 tempest-ServerRescueTestJSONUnderV235-1743615611 tempest-ServerRescueTestJSONUnderV235-1743615611-project-member] Enqueued Resource ID: 4a70577e-71a7-40b9-9b9e-1ced7534877d with Priority: HIGHEST for action security_group_rules [ 786.454133] env[65306]: INFO networking_nsxv3.common.synchronization [req-b5c9bf7e-8a54-4f63-b18a-2104b96cc5f4 req-b70702e8-43d4-4aac-bea7-4d70549898e6 tempest-ServerRescueTestJSONUnderV235-1743615611 tempest-ServerRescueTestJSONUnderV235-1743615611-project-member] Enqueued Resource ID: 4a70577e-71a7-40b9-9b9e-1ced7534877d with Priority: HIGHEST for action security_group_members [ 786.454362] env[65306]: INFO networking_nsxv3.common.synchronization [req-b5c9bf7e-8a54-4f63-b18a-2104b96cc5f4 req-b70702e8-43d4-4aac-bea7-4d70549898e6 tempest-ServerRescueTestJSONUnderV235-1743615611 tempest-ServerRescueTestJSONUnderV235-1743615611-project-member] Enqueued Resource ID: 01326337-1730-4c11-8d67-5edeeb790689 with Priority: HIGHEST for action port [ 786.455281] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 41ddc5e2-3eff-4217-8312-ffe238697b2c with Priority: HIGHEST for action security_group_rules [ 786.455476] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4a70577e-71a7-40b9-9b9e-1ced7534877d with Priority: HIGHEST for action security_group_rules [ 786.455590] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 01326337-1730-4c11-8d67-5edeeb790689 with Priority: HIGHEST for action port [ 786.455677] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 41ddc5e2-3eff-4217-8312-ffe238697b2c with Priority: HIGHEST for action security_group_members [ 786.455836] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4a70577e-71a7-40b9-9b9e-1ced7534877d with Priority: HIGHEST for action security_group_members [ 786.456255] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock rules-41ddc5e2-3eff-4217-8312-ffe238697b2c taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.456432] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-41ddc5e2-3eff-4217-8312-ffe238697b2c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.456508] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-41ddc5e2-3eff-4217-8312-ffe238697b2c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.456802] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-41ddc5e2-3eff-4217-8312-ffe238697b2c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.456889] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('41ddc5e2-3eff-4217-8312-ffe238697b2c',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.457932] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4a70577e-71a7-40b9-9b9e-1ced7534877d taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.458247] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4a70577e-71a7-40b9-9b9e-1ced7534877d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.458361] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4a70577e-71a7-40b9-9b9e-1ced7534877d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.458610] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4a70577e-71a7-40b9-9b9e-1ced7534877d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.458699] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4a70577e-71a7-40b9-9b9e-1ced7534877d',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.460134] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock port-01326337-1730-4c11-8d67-5edeeb790689 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.460277] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-01326337-1730-4c11-8d67-5edeeb790689" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.460336] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-01326337-1730-4c11-8d67-5edeeb790689" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.460547] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-01326337-1730-4c11-8d67-5edeeb790689" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.460676] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('01326337-1730-4c11-8d67-5edeeb790689',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.461631] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-41ddc5e2-3eff-4217-8312-ffe238697b2c taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.461736] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-41ddc5e2-3eff-4217-8312-ffe238697b2c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.462709] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-4a70577e-71a7-40b9-9b9e-1ced7534877d taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.462840] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4a70577e-71a7-40b9-9b9e-1ced7534877d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.784808] env[65306]: INFO networking_nsxv3.common.synchronization [None req-c8152f75-b182-46fd-bd03-68de5ea2ac62 tempest-ImagesOneServerNegativeTestJSON-105192947 tempest-ImagesOneServerNegativeTestJSON-105192947-project-member] Enqueued Resource ID: 022fcc7f-45d6-4168-9965-032c3cf9a503 with Priority: HIGHEST for action security_group_rules [ 786.785619] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 022fcc7f-45d6-4168-9965-032c3cf9a503 with Priority: HIGHEST for action security_group_rules [ 786.786140] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock rules-022fcc7f-45d6-4168-9965-032c3cf9a503 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.786289] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-022fcc7f-45d6-4168-9965-032c3cf9a503" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.786289] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-022fcc7f-45d6-4168-9965-032c3cf9a503" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.786598] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-022fcc7f-45d6-4168-9965-032c3cf9a503" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.786718] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('022fcc7f-45d6-4168-9965-032c3cf9a503',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.904089] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4a70577e-71a7-40b9-9b9e-1ced7534877d',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.906930] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('41ddc5e2-3eff-4217-8312-ffe238697b2c',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.949211] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.949360] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.949429] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.949894] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.949894] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.949894] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3eee5457-701b-405e-bdf2-f055e0150d49 is going to be updated. [ 786.964833] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-4a70577e-71a7-40b9-9b9e-1ced7534877d taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.965030] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4a70577e-71a7-40b9-9b9e-1ced7534877d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.965262] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 01326337-1730-4c11-8d67-5edeeb790689 with status ACTIVE [ 786.966562] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.966562] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.966562] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.966562] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.966562] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.966562] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.966562] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.966883] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.966883] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.966883] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.967061] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.967362] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.967362] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.967362] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.967472] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.967518] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 01326337-1730-4c11-8d67-5edeeb790689 is going to be updated. [ 786.969624] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-41ddc5e2-3eff-4217-8312-ffe238697b2c taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.969752] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-41ddc5e2-3eff-4217-8312-ffe238697b2c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.974454] env[65306]: INFO networking_nsxv3.common.synchronization [None req-2b31b4b0-c9ab-4c96-939f-6217ff065406 tempest-ImagesOneServerNegativeTestJSON-105192947 tempest-ImagesOneServerNegativeTestJSON-105192947-project-member] Enqueued Resource ID: 022fcc7f-45d6-4168-9965-032c3cf9a503 with Priority: HIGHEST for action security_group_rules [ 786.975862] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 022fcc7f-45d6-4168-9965-032c3cf9a503 with Priority: HIGHEST for action security_group_rules [ 786.975862] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock rules-022fcc7f-45d6-4168-9965-032c3cf9a503 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.976104] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-022fcc7f-45d6-4168-9965-032c3cf9a503" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.992039] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.992039] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.992039] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.992039] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.992039] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.007023] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.007023] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.007023] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.007023] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.007023] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.007023] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-01326337-1730-4c11-8d67-5edeeb790689" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.007023] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3eee5457-701b-405e-bdf2-f055e0150d49 in Status: IN_PROGRESS for 2s [ 787.159517] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f5174f7c-dc12-4dad-9284-eed34d64b830 in Status: SUCCESS [ 787.159736] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f5174f7c-dc12-4dad-9284-eed34d64b830" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.160030] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f5174f7c-dc12-4dad-9284-eed34d64b830" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.160403] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f5174f7c-dc12-4dad-9284-eed34d64b830" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.160706] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.160930] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.161016] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.161279] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.161391] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.161495] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f5174f7c-dc12-4dad-9284-eed34d64b830" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.161721] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-f5174f7c-dc12-4dad-9284-eed34d64b830 taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.161864] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f5174f7c-dc12-4dad-9284-eed34d64b830" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.161931] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f5174f7c-dc12-4dad-9284-eed34d64b830" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.162173] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f5174f7c-dc12-4dad-9284-eed34d64b830" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.162342] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.162456] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.162529] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.162690] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.162799] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.162924] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f5174f7c-dc12-4dad-9284-eed34d64b830" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.163037] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f5174f7c-dc12-4dad-9284-eed34d64b830',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 787.312179] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.313041] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.313041] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.313041] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.313041] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.313041] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 022fcc7f-45d6-4168-9965-032c3cf9a503 already deleted. [ 787.313041] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-022fcc7f-45d6-4168-9965-032c3cf9a503" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.313414] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-022fcc7f-45d6-4168-9965-032c3cf9a503" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.313414] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-022fcc7f-45d6-4168-9965-032c3cf9a503" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.313414] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('022fcc7f-45d6-4168-9965-032c3cf9a503',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 787.408162] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4a70577e-71a7-40b9-9b9e-1ced7534877d',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 787.409836] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('41ddc5e2-3eff-4217-8312-ffe238697b2c',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 787.665357] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f5174f7c-dc12-4dad-9284-eed34d64b830: rpc.has_security_group_logging(os_id): False [ 787.686772] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.688063] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.688063] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.688063] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.688063] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.688063] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.688063] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.688063] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.688340] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.688340] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.688410] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.688602] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.688602] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.688700] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.688773] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.688955] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.689168] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.689301] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.689436] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.689512] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.689601] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f5174f7c-dc12-4dad-9284-eed34d64b830 is going to be updated. [ 787.768981] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.768981] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.768981] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.768981] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.768981] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.787697] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f5174f7c-dc12-4dad-9284-eed34d64b830 in Status: IN_PROGRESS for 2s [ 787.844550] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.844721] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.844791] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.845036] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.845136] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.845357] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 022fcc7f-45d6-4168-9965-032c3cf9a503 already deleted. [ 787.845357] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-022fcc7f-45d6-4168-9965-032c3cf9a503" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.915461] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.915461] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.915461] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.915786] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.915959] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.916125] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4a70577e-71a7-40b9-9b9e-1ced7534877d is going to be created. [ 787.917797] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.918426] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.918560] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.918810] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.918951] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.919163] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 41ddc5e2-3eff-4217-8312-ffe238697b2c is going to be updated. [ 787.957227] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.957527] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.957527] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.957692] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.957818] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.960894] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.960894] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.960894] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.960894] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.961359] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.968880] env[65306]: INFO networking_nsxv3.common.synchronization [req-83d85322-5da8-4c3c-a910-091cf3578774 req-0fa05314-b7be-473d-80d8-9e0de60d36fa tempest-ServerRescueTestJSONUnderV235-1743615611 tempest-ServerRescueTestJSONUnderV235-1743615611-project-member] Enqueued Resource ID: 4a70577e-71a7-40b9-9b9e-1ced7534877d with Priority: HIGHEST for action security_group_members [ 787.969079] env[65306]: INFO networking_nsxv3.common.synchronization [req-83d85322-5da8-4c3c-a910-091cf3578774 req-0fa05314-b7be-473d-80d8-9e0de60d36fa tempest-ServerRescueTestJSONUnderV235-1743615611 tempest-ServerRescueTestJSONUnderV235-1743615611-project-member] Enqueued Resource ID: 41ddc5e2-3eff-4217-8312-ffe238697b2c with Priority: HIGHEST for action security_group_members [ 787.969708] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4a70577e-71a7-40b9-9b9e-1ced7534877d with Priority: HIGHEST for action security_group_members [ 787.970618] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 41ddc5e2-3eff-4217-8312-ffe238697b2c with Priority: HIGHEST for action security_group_members [ 787.970736] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-4a70577e-71a7-40b9-9b9e-1ced7534877d taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.970859] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4a70577e-71a7-40b9-9b9e-1ced7534877d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.972031] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-41ddc5e2-3eff-4217-8312-ffe238697b2c taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.972031] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-41ddc5e2-3eff-4217-8312-ffe238697b2c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.980666] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 41ddc5e2-3eff-4217-8312-ffe238697b2c in Status: IN_PROGRESS for 2s [ 787.981229] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4a70577e-71a7-40b9-9b9e-1ced7534877d in Status: UNINITIALIZED for 2s [ 788.041015] env[65306]: INFO networking_nsxv3.common.synchronization [req-83d85322-5da8-4c3c-a910-091cf3578774 req-0fa05314-b7be-473d-80d8-9e0de60d36fa tempest-ServerRescueTestJSONUnderV235-1743615611 tempest-ServerRescueTestJSONUnderV235-1743615611-project-member] Enqueued Resource ID: 41ddc5e2-3eff-4217-8312-ffe238697b2c with Priority: HIGHEST for action security_group_rules [ 788.041495] env[65306]: INFO networking_nsxv3.common.synchronization [req-83d85322-5da8-4c3c-a910-091cf3578774 req-0fa05314-b7be-473d-80d8-9e0de60d36fa tempest-ServerRescueTestJSONUnderV235-1743615611 tempest-ServerRescueTestJSONUnderV235-1743615611-project-member] Enqueued Resource ID: 41ddc5e2-3eff-4217-8312-ffe238697b2c with Priority: HIGHEST for action security_group_members [ 788.041495] env[65306]: INFO networking_nsxv3.common.synchronization [req-83d85322-5da8-4c3c-a910-091cf3578774 req-0fa05314-b7be-473d-80d8-9e0de60d36fa tempest-ServerRescueTestJSONUnderV235-1743615611 tempest-ServerRescueTestJSONUnderV235-1743615611-project-member] Enqueued Resource ID: 01326337-1730-4c11-8d67-5edeeb790689 with Priority: HIGHEST for action port [ 788.042642] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c3a4b03d-2231-4b42-a522-be404c2784e5 in Status: SUCCESS [ 788.042951] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c3a4b03d-2231-4b42-a522-be404c2784e5" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.043592] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 41ddc5e2-3eff-4217-8312-ffe238697b2c with Priority: HIGHEST for action security_group_rules [ 788.043850] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 41ddc5e2-3eff-4217-8312-ffe238697b2c with Priority: HIGHEST for action security_group_members [ 788.044019] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 01326337-1730-4c11-8d67-5edeeb790689 with Priority: HIGHEST for action port [ 788.044211] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c3a4b03d-2231-4b42-a522-be404c2784e5" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.044486] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c3a4b03d-2231-4b42-a522-be404c2784e5" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.044849] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.044941] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.045022] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.045492] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.045492] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.045492] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c3a4b03d-2231-4b42-a522-be404c2784e5" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.045660] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c3a4b03d-2231-4b42-a522-be404c2784e5',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.046969] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock rules-41ddc5e2-3eff-4217-8312-ffe238697b2c taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.046969] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-41ddc5e2-3eff-4217-8312-ffe238697b2c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.047184] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-41ddc5e2-3eff-4217-8312-ffe238697b2c taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.047233] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-41ddc5e2-3eff-4217-8312-ffe238697b2c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.047461] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock port-01326337-1730-4c11-8d67-5edeeb790689 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.047568] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-01326337-1730-4c11-8d67-5edeeb790689" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.047726] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-01326337-1730-4c11-8d67-5edeeb790689" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.047887] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-01326337-1730-4c11-8d67-5edeeb790689" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.047933] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('01326337-1730-4c11-8d67-5edeeb790689',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.448776] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9e80329d-1fcd-4c50-8991-a90e2a1fbdbc in Status: SUCCESS [ 788.449159] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9e80329d-1fcd-4c50-8991-a90e2a1fbdbc" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.550969] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-c3a4b03d-2231-4b42-a522-be404c2784e5 taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.551227] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c3a4b03d-2231-4b42-a522-be404c2784e5" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.551342] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c3a4b03d-2231-4b42-a522-be404c2784e5" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.551660] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c3a4b03d-2231-4b42-a522-be404c2784e5" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.552049] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.552228] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.552309] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.553621] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.553621] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.553621] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c3a4b03d-2231-4b42-a522-be404c2784e5" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.553621] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-c3a4b03d-2231-4b42-a522-be404c2784e5 taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.553621] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c3a4b03d-2231-4b42-a522-be404c2784e5" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.553621] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c3a4b03d-2231-4b42-a522-be404c2784e5" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.554705] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c3a4b03d-2231-4b42-a522-be404c2784e5" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.554829] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.554960] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.557101] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.557101] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.557101] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.557101] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c3a4b03d-2231-4b42-a522-be404c2784e5" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.557101] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c3a4b03d-2231-4b42-a522-be404c2784e5',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.557101] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 01326337-1730-4c11-8d67-5edeeb790689 with status ACTIVE [ 788.557101] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.557101] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.557101] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.557649] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.557649] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.558205] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.558350] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.558432] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.561336] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.561336] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.561336] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.561336] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.561336] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.561336] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.561336] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.561336] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 01326337-1730-4c11-8d67-5edeeb790689 is going to be updated. [ 788.586632] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.586804] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.586868] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.587450] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.587603] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.587766] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-01326337-1730-4c11-8d67-5edeeb790689" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.021341] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3eee5457-701b-405e-bdf2-f055e0150d49 in Status: SUCCESS [ 789.021551] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3eee5457-701b-405e-bdf2-f055e0150d49" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.069024] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c3a4b03d-2231-4b42-a522-be404c2784e5: rpc.has_security_group_logging(os_id): False [ 789.088454] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.089068] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.089068] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.089068] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.089345] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.089444] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.089640] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.089708] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.089896] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.089974] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.090374] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.090492] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.090569] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.090895] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.090895] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.092386] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.092545] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.092728] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.092968] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.093098] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.093225] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c3a4b03d-2231-4b42-a522-be404c2784e5 is going to be created. [ 789.164010] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.164225] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.164632] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.164962] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.165262] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.193447] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c3a4b03d-2231-4b42-a522-be404c2784e5 in Status: IN_PROGRESS for 2s [ 789.805111] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f5174f7c-dc12-4dad-9284-eed34d64b830 in Status: SUCCESS [ 789.805400] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f5174f7c-dc12-4dad-9284-eed34d64b830" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.805726] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f5174f7c-dc12-4dad-9284-eed34d64b830" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.806108] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f5174f7c-dc12-4dad-9284-eed34d64b830" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.806251] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f5174f7c-dc12-4dad-9284-eed34d64b830',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.997182] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 41ddc5e2-3eff-4217-8312-ffe238697b2c in Status: SUCCESS [ 789.997899] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-41ddc5e2-3eff-4217-8312-ffe238697b2c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.999709] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4a70577e-71a7-40b9-9b9e-1ced7534877d in Status: SUCCESS [ 789.999907] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4a70577e-71a7-40b9-9b9e-1ced7534877d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.000221] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-41ddc5e2-3eff-4217-8312-ffe238697b2c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.000444] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-41ddc5e2-3eff-4217-8312-ffe238697b2c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.000640] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.000760] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.000834] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.000976] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.001061] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.001164] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('41ddc5e2-3eff-4217-8312-ffe238697b2c',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 790.002225] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4a70577e-71a7-40b9-9b9e-1ced7534877d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.003615] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4a70577e-71a7-40b9-9b9e-1ced7534877d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.003914] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.004492] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.004492] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.005799] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.005799] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.005935] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4a70577e-71a7-40b9-9b9e-1ced7534877d',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 790.309712] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-f5174f7c-dc12-4dad-9284-eed34d64b830 taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.310043] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f5174f7c-dc12-4dad-9284-eed34d64b830" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.310043] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f5174f7c-dc12-4dad-9284-eed34d64b830" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.310323] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f5174f7c-dc12-4dad-9284-eed34d64b830" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.310528] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.310637] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.310709] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.310874] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.310958] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.311154] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f5174f7c-dc12-4dad-9284-eed34d64b830" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.311208] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f5174f7c-dc12-4dad-9284-eed34d64b830',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 790.508649] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('41ddc5e2-3eff-4217-8312-ffe238697b2c',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 790.509945] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.510249] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.510380] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.510624] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.510716] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.510936] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.511043] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.511092] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.511259] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.511328] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.511422] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4a70577e-71a7-40b9-9b9e-1ced7534877d is going to be deleted. [ 790.563222] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.563413] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.564154] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.564154] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.564154] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.564154] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4a70577e-71a7-40b9-9b9e-1ced7534877d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.564154] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4a70577e-71a7-40b9-9b9e-1ced7534877d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.564353] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4a70577e-71a7-40b9-9b9e-1ced7534877d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.565030] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.565030] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.565030] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.565030] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.565030] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.565309] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4a70577e-71a7-40b9-9b9e-1ced7534877d',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 790.814605] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-f5174f7c-dc12-4dad-9284-eed34d64b830 taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.815016] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f5174f7c-dc12-4dad-9284-eed34d64b830" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.815016] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f5174f7c-dc12-4dad-9284-eed34d64b830" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.815227] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f5174f7c-dc12-4dad-9284-eed34d64b830" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.815351] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.815451] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.815514] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.816380] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.816380] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.816380] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f5174f7c-dc12-4dad-9284-eed34d64b830" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.816380] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-f5174f7c-dc12-4dad-9284-eed34d64b830 taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.816380] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f5174f7c-dc12-4dad-9284-eed34d64b830" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.816380] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f5174f7c-dc12-4dad-9284-eed34d64b830" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.816380] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f5174f7c-dc12-4dad-9284-eed34d64b830" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.816671] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.816671] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.816671] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.816808] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.816946] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.816946] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f5174f7c-dc12-4dad-9284-eed34d64b830" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.817060] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f5174f7c-dc12-4dad-9284-eed34d64b830',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.013806] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('41ddc5e2-3eff-4217-8312-ffe238697b2c',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.067477] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.067679] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.067746] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.067919] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.068021] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.068296] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.068417] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.068488] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.071050] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.071050] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.071050] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4a70577e-71a7-40b9-9b9e-1ced7534877d already deleted. [ 791.071050] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4a70577e-71a7-40b9-9b9e-1ced7534877d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.071050] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4a70577e-71a7-40b9-9b9e-1ced7534877d',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.071567] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4a70577e-71a7-40b9-9b9e-1ced7534877d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.071829] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4a70577e-71a7-40b9-9b9e-1ced7534877d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.072112] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.072256] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.072362] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.074755] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.074755] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.074755] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4a70577e-71a7-40b9-9b9e-1ced7534877d',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.214460] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c3a4b03d-2231-4b42-a522-be404c2784e5 in Status: SUCCESS [ 791.214709] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c3a4b03d-2231-4b42-a522-be404c2784e5" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.319993] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f5174f7c-dc12-4dad-9284-eed34d64b830: rpc.has_security_group_logging(os_id): False [ 791.349338] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.349338] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.349338] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.349609] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.349659] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.351044] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.351044] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.351044] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.351044] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.351044] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.351044] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.351044] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.351044] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.351044] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.351044] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.351824] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.351824] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.351824] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.351824] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.351824] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.352107] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f5174f7c-dc12-4dad-9284-eed34d64b830 is going to be updated. [ 791.482036] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.482211] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.482280] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.482510] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.482622] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.502206] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f5174f7c-dc12-4dad-9284-eed34d64b830 in Status: IN_PROGRESS for 2s [ 791.518693] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.518693] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.518693] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.518693] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.518693] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.519147] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 41ddc5e2-3eff-4217-8312-ffe238697b2c is going to be updated. [ 791.562387] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.562387] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.562387] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.562387] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.562387] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.575139] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4a70577e-71a7-40b9-9b9e-1ced7534877d',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.576460] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.576855] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.576855] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.576959] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.578211] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.578211] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.578211] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.578211] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.578211] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.578211] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.578211] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4a70577e-71a7-40b9-9b9e-1ced7534877d already deleted. [ 791.578211] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4a70577e-71a7-40b9-9b9e-1ced7534877d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.579522] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 41ddc5e2-3eff-4217-8312-ffe238697b2c in Status: IN_PROGRESS for 2s [ 792.080829] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4a70577e-71a7-40b9-9b9e-1ced7534877d: rpc.has_security_group_logging(os_id): False [ 792.105482] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.105700] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.105762] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.105966] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.106101] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.106367] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.106480] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.106565] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.106807] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.106913] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.107018] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4a70577e-71a7-40b9-9b9e-1ced7534877d is going to be created. [ 792.133750] env[65306]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/4a70577e-71a7-40b9-9b9e-1ced7534877d], does not exist path=[/infra/domains/default/groups/4a70577e-71a7-40b9-9b9e-1ced7534877d]."\n}' [ 792.133955] env[65306]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4a70577e-71a7-40b9-9b9e-1ced7534877d failed to be updated, retrying after metadata refresh: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/4a70577e-71a7-40b9-9b9e-1ced7534877d [ 792.134075] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 792.176696] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.176696] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.176696] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.176696] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.178294] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.178456] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.178551] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.178835] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.178835] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.178934] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.179203] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.179338] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.179403] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.179554] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.179655] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.179706] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4a70577e-71a7-40b9-9b9e-1ced7534877d is going to be created. [ 792.204478] env[65306]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/4a70577e-71a7-40b9-9b9e-1ced7534877d], does not exist path=[/infra/domains/default/groups/4a70577e-71a7-40b9-9b9e-1ced7534877d]."\n}': requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/4a70577e-71a7-40b9-9b9e-1ced7534877d [ 792.204666] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4a70577e-71a7-40b9-9b9e-1ced7534877d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.205337] env[65306]: Traceback (most recent call last): [ 792.205337] env[65306]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 36, in wrapper [ 792.205337] env[65306]: return func(*args, **kwargs) [ 792.205337] env[65306]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 792.205337] env[65306]: res.raise_for_status() [ 792.205337] env[65306]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1026, in raise_for_status [ 792.205337] env[65306]: raise HTTPError(http_error_msg, response=self) [ 792.205337] env[65306]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/4a70577e-71a7-40b9-9b9e-1ced7534877d [ 792.205337] env[65306]: During handling of the above exception, another exception occurred: [ 792.205337] env[65306]: Traceback (most recent call last): [ 792.205337] env[65306]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/hubs/poll.py", line 111, in wait [ 792.205337] env[65306]: listener.cb(fileno) [ 792.205337] env[65306]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py", line 272, in main [ 792.205337] env[65306]: result = function(*args, **kwargs) [ 792.205337] env[65306]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py", line 210, in security_group_rules [ 792.205337] env[65306]: self.nsx_provider.sg_rules_realize(os_sg, logged=logged) [ 792.205337] env[65306]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 1012, in sg_rules_realize [ 792.205337] env[65306]: return self._realize(Provider.SG_RULES, delete, self.payload.sg_rules_container, os_sg, provider_sg) [ 792.205337] env[65306]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 45, in wrapper [ 792.205337] env[65306]: return func(self, resource_type, delete, self.payload.sg_rules_container, os_obj, provider_sg) [ 792.205337] env[65306]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 792.205337] env[65306]: res.raise_for_status() [ 792.205337] env[65306]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1026, in raise_for_status [ 792.205337] env[65306]: raise HTTPError(http_error_msg, response=self) [ 792.205337] env[65306]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/4a70577e-71a7-40b9-9b9e-1ced7534877d [ 792.205337] env[65306]: Removing descriptor: 5 [ 792.808812] env[65306]: INFO networking_nsxv3.common.synchronization [req-ae26b6cc-e18a-45b5-8cb0-e098f01d0c9a req-8e00ae93-537a-4bbd-b874-11741092fae5 tempest-ServersTestMultiNic-959517935 tempest-ServersTestMultiNic-959517935-project-member] Enqueued Resource ID: f5174f7c-dc12-4dad-9284-eed34d64b830 with Priority: HIGHEST for action security_group_members [ 792.809475] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f5174f7c-dc12-4dad-9284-eed34d64b830 with Priority: HIGHEST for action security_group_members [ 792.809828] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-f5174f7c-dc12-4dad-9284-eed34d64b830 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.809975] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f5174f7c-dc12-4dad-9284-eed34d64b830" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.810074] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f5174f7c-dc12-4dad-9284-eed34d64b830" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.810513] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f5174f7c-dc12-4dad-9284-eed34d64b830" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.810513] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.810639] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.810730] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.810948] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.811055] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.811129] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f5174f7c-dc12-4dad-9284-eed34d64b830',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 793.057162] env[65306]: INFO networking_nsxv3.common.synchronization [req-ae26b6cc-e18a-45b5-8cb0-e098f01d0c9a req-f8bcb697-b007-4043-b798-ec7173871fab tempest-ServersTestMultiNic-959517935 tempest-ServersTestMultiNic-959517935-project-member] Enqueued Resource ID: f5174f7c-dc12-4dad-9284-eed34d64b830 with Priority: HIGHEST for action security_group_members [ 793.058074] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f5174f7c-dc12-4dad-9284-eed34d64b830 with Priority: HIGHEST for action security_group_members [ 793.058721] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-f5174f7c-dc12-4dad-9284-eed34d64b830 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.058881] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f5174f7c-dc12-4dad-9284-eed34d64b830" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.315252] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f5174f7c-dc12-4dad-9284-eed34d64b830',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 793.517655] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f5174f7c-dc12-4dad-9284-eed34d64b830 in Status: SUCCESS [ 793.517902] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f5174f7c-dc12-4dad-9284-eed34d64b830" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.593842] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 41ddc5e2-3eff-4217-8312-ffe238697b2c in Status: SUCCESS [ 793.594348] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-41ddc5e2-3eff-4217-8312-ffe238697b2c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.594652] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-41ddc5e2-3eff-4217-8312-ffe238697b2c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.595048] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-41ddc5e2-3eff-4217-8312-ffe238697b2c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.595382] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.595688] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.596030] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.596030] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.596300] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.597023] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-41ddc5e2-3eff-4217-8312-ffe238697b2c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.597023] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('41ddc5e2-3eff-4217-8312-ffe238697b2c',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 793.597993] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-41ddc5e2-3eff-4217-8312-ffe238697b2c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.599788] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-41ddc5e2-3eff-4217-8312-ffe238697b2c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.599788] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.599788] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.599788] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.599788] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.599788] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.599788] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('41ddc5e2-3eff-4217-8312-ffe238697b2c',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 793.817344] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f5174f7c-dc12-4dad-9284-eed34d64b830',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.100756] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-41ddc5e2-3eff-4217-8312-ffe238697b2c taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.100927] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-41ddc5e2-3eff-4217-8312-ffe238697b2c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.103415] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('41ddc5e2-3eff-4217-8312-ffe238697b2c',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.324553] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.324553] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.324553] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.324553] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.324553] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.324553] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f5174f7c-dc12-4dad-9284-eed34d64b830 is going to be updated. [ 794.355194] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.355194] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.355194] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.355194] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.355194] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.365021] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f5174f7c-dc12-4dad-9284-eed34d64b830 in Status: IN_PROGRESS for 2s [ 794.607028] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('41ddc5e2-3eff-4217-8312-ffe238697b2c',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.115594] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.115594] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.115594] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.115594] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.115594] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.115594] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 41ddc5e2-3eff-4217-8312-ffe238697b2c is going to be updated. [ 795.149614] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.150244] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.150244] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.150952] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.150952] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.164049] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 41ddc5e2-3eff-4217-8312-ffe238697b2c in Status: IN_PROGRESS for 2s [ 796.377141] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f5174f7c-dc12-4dad-9284-eed34d64b830 in Status: SUCCESS [ 796.377465] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f5174f7c-dc12-4dad-9284-eed34d64b830" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.377959] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f5174f7c-dc12-4dad-9284-eed34d64b830" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.378271] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f5174f7c-dc12-4dad-9284-eed34d64b830" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.378520] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.378681] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.378772] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.378976] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.379109] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.379237] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f5174f7c-dc12-4dad-9284-eed34d64b830',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.883371] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.883371] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.883371] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.883744] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.911864] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.912150] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.912273] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.912342] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.912672] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.912767] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.912871] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f5174f7c-dc12-4dad-9284-eed34d64b830 is going to be updated. [ 796.966260] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.966521] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.966582] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.966885] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.967072] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.978155] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f5174f7c-dc12-4dad-9284-eed34d64b830 in Status: IN_PROGRESS for 2s [ 797.175079] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 41ddc5e2-3eff-4217-8312-ffe238697b2c in Status: SUCCESS [ 797.175312] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-41ddc5e2-3eff-4217-8312-ffe238697b2c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.175486] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-41ddc5e2-3eff-4217-8312-ffe238697b2c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.175702] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-41ddc5e2-3eff-4217-8312-ffe238697b2c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.175885] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.176011] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.176087] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.176285] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.176358] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.176636] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('41ddc5e2-3eff-4217-8312-ffe238697b2c',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 797.426295] env[65306]: INFO networking_nsxv3.common.synchronization [req-8929eacd-1a58-48c5-a5c2-1f44d3740b8c req-b2488c5a-e576-4299-9fc3-b773851d64e3 tempest-ServerAddressesTestJSON-35391964 tempest-ServerAddressesTestJSON-35391964-project-member] Enqueued Resource ID: 5c095c1f-60f5-47d0-b270-e33f847ba33b with Priority: HIGHEST for action security_group_members [ 797.426963] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5c095c1f-60f5-47d0-b270-e33f847ba33b with Priority: HIGHEST for action security_group_members [ 797.427665] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-5c095c1f-60f5-47d0-b270-e33f847ba33b taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.427813] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5c095c1f-60f5-47d0-b270-e33f847ba33b" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.427866] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5c095c1f-60f5-47d0-b270-e33f847ba33b" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.428090] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5c095c1f-60f5-47d0-b270-e33f847ba33b" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.428314] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.428410] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.428480] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.428647] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.428736] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.428830] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5c095c1f-60f5-47d0-b270-e33f847ba33b',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 797.678969] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('41ddc5e2-3eff-4217-8312-ffe238697b2c',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 797.931544] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.931713] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.931787] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.932099] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.953422] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.953696] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.953851] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.953885] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.954156] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.954156] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.954315] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5c095c1f-60f5-47d0-b270-e33f847ba33b is going to be updated. [ 797.988363] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.988531] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.988580] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.988838] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.988922] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.001948] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5c095c1f-60f5-47d0-b270-e33f847ba33b in Status: IN_PROGRESS for 2s [ 798.181282] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('41ddc5e2-3eff-4217-8312-ffe238697b2c',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.686928] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.686928] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.686928] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.686928] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.686928] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.686928] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 41ddc5e2-3eff-4217-8312-ffe238697b2c is going to be updated. [ 798.716963] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.717552] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.719030] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.719030] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.719030] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.732242] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 41ddc5e2-3eff-4217-8312-ffe238697b2c in Status: IN_PROGRESS for 2s [ 798.992901] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f5174f7c-dc12-4dad-9284-eed34d64b830 in Status: SUCCESS [ 798.993124] env[65306]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f5174f7c-dc12-4dad-9284-eed34d64b830 deletion is rescheduled due to dependency. [ 798.993245] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f5174f7c-dc12-4dad-9284-eed34d64b830" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.254565] env[65306]: INFO networking_nsxv3.common.synchronization [req-724a04ca-33c5-4981-959f-2966a0150bfa req-e46348a6-d6d5-48e1-9c8b-da0284857bf0 tempest-ServerRescueTestJSONUnderV235-1743615611 tempest-ServerRescueTestJSONUnderV235-1743615611-project-member] Enqueued Resource ID: 41ddc5e2-3eff-4217-8312-ffe238697b2c with Priority: HIGHEST for action security_group_members [ 799.255079] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 41ddc5e2-3eff-4217-8312-ffe238697b2c with Priority: HIGHEST for action security_group_members [ 799.255759] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-41ddc5e2-3eff-4217-8312-ffe238697b2c taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.255759] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-41ddc5e2-3eff-4217-8312-ffe238697b2c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.013303] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5c095c1f-60f5-47d0-b270-e33f847ba33b in Status: SUCCESS [ 800.013816] env[65306]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5c095c1f-60f5-47d0-b270-e33f847ba33b deletion is rescheduled due to dependency. [ 800.013816] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5c095c1f-60f5-47d0-b270-e33f847ba33b" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.074518] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.074686] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.074762] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.074982] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.075107] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 800.577854] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 800.744961] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 41ddc5e2-3eff-4217-8312-ffe238697b2c in Status: SUCCESS [ 800.747019] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-41ddc5e2-3eff-4217-8312-ffe238697b2c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.747019] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-41ddc5e2-3eff-4217-8312-ffe238697b2c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.747019] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-41ddc5e2-3eff-4217-8312-ffe238697b2c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.747019] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.747019] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.747019] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.747019] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.747019] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.747019] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-41ddc5e2-3eff-4217-8312-ffe238697b2c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.747951] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-41ddc5e2-3eff-4217-8312-ffe238697b2c taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.748245] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-41ddc5e2-3eff-4217-8312-ffe238697b2c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.751563] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-41ddc5e2-3eff-4217-8312-ffe238697b2c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.751563] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-41ddc5e2-3eff-4217-8312-ffe238697b2c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.751563] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.751563] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.751563] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.751563] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.751563] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.751563] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-41ddc5e2-3eff-4217-8312-ffe238697b2c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.751563] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('41ddc5e2-3eff-4217-8312-ffe238697b2c',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 800.751563] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-41ddc5e2-3eff-4217-8312-ffe238697b2c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.751563] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-41ddc5e2-3eff-4217-8312-ffe238697b2c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.751563] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.751563] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.751563] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.751563] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.752512] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.752916] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('41ddc5e2-3eff-4217-8312-ffe238697b2c',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 801.082073] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 801.255787] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 41ddc5e2-3eff-4217-8312-ffe238697b2c: rpc.has_security_group_logging(os_id): False [ 801.259062] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.259219] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.259292] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.259554] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.278037] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.278506] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.285312] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.285647] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.285776] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.285846] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.286112] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.286231] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.286449] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 41ddc5e2-3eff-4217-8312-ffe238697b2c is going to be updated. [ 801.291664] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.291956] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.292030] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.292293] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.292458] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.292542] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.292747] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.292836] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.293076] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.293225] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.293278] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.293443] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.293488] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.294630] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.294630] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.294630] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.294630] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.294630] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.294630] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 41ddc5e2-3eff-4217-8312-ffe238697b2c is going to be updated. [ 801.326939] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.326939] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.326939] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.326939] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.327205] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.342264] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 41ddc5e2-3eff-4217-8312-ffe238697b2c in Status: IN_PROGRESS for 2s [ 801.372746] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.372918] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.372952] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.373279] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.373463] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.388147] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 41ddc5e2-3eff-4217-8312-ffe238697b2c in Status: IN_PROGRESS for 2s [ 801.586009] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 801.586210] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 802.244637] env[65306]: INFO networking_nsxv3.common.synchronization [req-a5d1415d-1ef0-432d-8340-bac9a97df072 req-f2826484-3c3e-4f5b-920d-361c38c28e44 tempest-ServersTestManualDisk-1886184172 tempest-ServersTestManualDisk-1886184172-project-member] Enqueued Resource ID: 3d7e63c8-5b54-4e8c-889b-658da24748dc with Priority: HIGHEST for action security_group_members [ 802.244923] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3d7e63c8-5b54-4e8c-889b-658da24748dc with Priority: HIGHEST for action security_group_members [ 802.245396] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-3d7e63c8-5b54-4e8c-889b-658da24748dc taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.245524] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3d7e63c8-5b54-4e8c-889b-658da24748dc" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.245627] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3d7e63c8-5b54-4e8c-889b-658da24748dc" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.245856] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3d7e63c8-5b54-4e8c-889b-658da24748dc" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.246059] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.246669] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.246669] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.246669] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.246669] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.246669] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3d7e63c8-5b54-4e8c-889b-658da24748dc',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 802.613705] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.613978] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.613978] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.614226] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.632681] env[65306]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 802.633758] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.635070] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 802.664248] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.664410] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.664410] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.664621] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.672100] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.672248] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 802.672300] env[65306]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=65306) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 802.672412] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 802.709712] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.709903] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.710014] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.710259] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.711074] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.711358] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 802.750301] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.750515] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.750593] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.750904] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.777684] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.777855] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.777977] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.778058] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.782040] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.782040] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.782040] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3d7e63c8-5b54-4e8c-889b-658da24748dc is going to be updated. [ 802.786066] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.786280] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.786375] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.786516] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.786742] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.786925] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 802.816074] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.816253] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.816329] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.816567] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.816720] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.828884] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3d7e63c8-5b54-4e8c-889b-658da24748dc in Status: IN_PROGRESS for 2s [ 802.860829] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.861023] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.861149] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.861345] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.861553] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.861826] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:32. [ 802.861919] env[65306]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'18bb45c8-7cab-44a5-887c-82deb65b8e26', '57bb6fe9-98c4-47f0-9daa-c424a0c9dfee', '9e80329d-1fcd-4c50-8991-a90e2a1fbdbc', 'aceee07e-3675-474c-96e8-9fe510f1356f', 'a05c132c-ec2c-4f0a-90d8-a619996ad7aa', '41ddc5e2-3eff-4217-8312-ffe238697b2c', '8beaaac6-ba63-44e8-a960-7e228e2e7d37', '7f0c403f-7209-472e-8592-d169f66791c9', 'ed6cda65-baf0-42a6-bcdd-7a946b27c841', 'ef5de9e7-0c3b-4386-af3c-de134eff75f3', '70b8bb37-9445-4339-82b5-ebb24bd0be78', '0defdd0d-cdbe-4a7c-9871-fd4c40a3847e', 'ca47d813-3b19-4aa2-8339-4f933a85963f', '46299e31-1097-4753-8f76-35280209d73c', '6951f012-9730-40bd-a7af-9b70cd598b05', '37349b8b-c2c1-4141-8b10-752c27492cbd', '3eee5457-701b-405e-bdf2-f055e0150d49', '3d7e63c8-5b54-4e8c-889b-658da24748dc', 'df9d38aa-4663-42d9-8451-f5b81969567d', '934be6c8-f61f-4a11-9b02-e48c8e4ae509', '830915ca-b7ed-480d-8dcc-06210706a96a', '55a6ae08-0730-4d04-bc2c-3f0c36758315', 'a7dafaf4-f702-4dc9-bc77-265f5268966a', '5188a191-fc4a-4216-b94f-2b854c8abd88', '5ec09b70-aa5a-48ff-b72f-a5c6c81190e0', '30524546-2ed3-474c-bf2b-fc6aff50dfec', '5c095c1f-60f5-47d0-b270-e33f847ba33b', 'f5174f7c-dc12-4dad-9284-eed34d64b830', 'e3e0f6b2-2984-4938-adcc-0374a714ff76', 'c3a4b03d-2231-4b42-a522-be404c2784e5', '4e234e08-a192-4c7a-badf-3e57629854d7', '6e403189-fcac-40e3-aa50-4c17f4d29895'} {{(pid=65306) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 802.862050] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 802.894819] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.894819] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.894819] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.894819] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.894819] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.894819] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 802.894819] env[65306]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=65306) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 802.894819] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 802.985831] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.985831] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.985831] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.988101] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.988101] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.988101] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 802.988101] env[65306]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=65306) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 802.988101] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 802.988101] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 802.988512] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 20/32 resources of Type:Security Group Rules [ 802.988512] env[65306]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 18bb45c8-7cab-44a5-887c-82deb65b8e26 with Priority: HIGH for action security_group_rules [ 802.988635] env[65306]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 57bb6fe9-98c4-47f0-9daa-c424a0c9dfee with Priority: HIGH for action security_group_rules [ 802.988692] env[65306]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 9e80329d-1fcd-4c50-8991-a90e2a1fbdbc with Priority: HIGH for action security_group_rules [ 802.988931] env[65306]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: aceee07e-3675-474c-96e8-9fe510f1356f with Priority: HIGH for action security_group_rules [ 802.988931] env[65306]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: a05c132c-ec2c-4f0a-90d8-a619996ad7aa with Priority: HIGH for action security_group_rules [ 802.988931] env[65306]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 41ddc5e2-3eff-4217-8312-ffe238697b2c with Priority: HIGH for action security_group_rules [ 802.989221] env[65306]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 8beaaac6-ba63-44e8-a960-7e228e2e7d37 with Priority: HIGH for action security_group_rules [ 802.989221] env[65306]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 7f0c403f-7209-472e-8592-d169f66791c9 with Priority: HIGH for action security_group_rules [ 802.989221] env[65306]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: ed6cda65-baf0-42a6-bcdd-7a946b27c841 with Priority: HIGH for action security_group_rules [ 802.989221] env[65306]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: ef5de9e7-0c3b-4386-af3c-de134eff75f3 with Priority: HIGH for action security_group_rules [ 802.989392] env[65306]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 70b8bb37-9445-4339-82b5-ebb24bd0be78 with Priority: HIGH for action security_group_rules [ 802.989392] env[65306]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 0defdd0d-cdbe-4a7c-9871-fd4c40a3847e with Priority: HIGH for action security_group_rules [ 802.989485] env[65306]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: ca47d813-3b19-4aa2-8339-4f933a85963f with Priority: HIGH for action security_group_rules [ 802.989532] env[65306]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 46299e31-1097-4753-8f76-35280209d73c with Priority: HIGH for action security_group_rules [ 802.989577] env[65306]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 6951f012-9730-40bd-a7af-9b70cd598b05 with Priority: HIGH for action security_group_rules [ 802.989622] env[65306]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 37349b8b-c2c1-4141-8b10-752c27492cbd with Priority: HIGH for action security_group_rules [ 802.989674] env[65306]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 3eee5457-701b-405e-bdf2-f055e0150d49 with Priority: HIGH for action security_group_rules [ 802.989772] env[65306]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 3d7e63c8-5b54-4e8c-889b-658da24748dc with Priority: HIGH for action security_group_rules [ 802.989843] env[65306]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: df9d38aa-4663-42d9-8451-f5b81969567d with Priority: HIGH for action security_group_rules [ 802.989897] env[65306]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 934be6c8-f61f-4a11-9b02-e48c8e4ae509 with Priority: HIGH for action security_group_rules [ 802.990032] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.355930] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 41ddc5e2-3eff-4217-8312-ffe238697b2c in Status: SUCCESS [ 803.355930] env[65306]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 41ddc5e2-3eff-4217-8312-ffe238697b2c deletion is rescheduled due to dependency. [ 803.356441] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-41ddc5e2-3eff-4217-8312-ffe238697b2c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.402194] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 41ddc5e2-3eff-4217-8312-ffe238697b2c in Status: SUCCESS [ 803.404056] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-41ddc5e2-3eff-4217-8312-ffe238697b2c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.404056] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-41ddc5e2-3eff-4217-8312-ffe238697b2c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.404056] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-41ddc5e2-3eff-4217-8312-ffe238697b2c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.404056] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('41ddc5e2-3eff-4217-8312-ffe238697b2c',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 803.540032] env[65306]: INFO networking_nsxv3.common.synchronization [req-9cdd5d39-02aa-42af-a03f-e3e0adb66855 req-06441d69-ae5e-4b73-9832-4ca3ad21d388 tempest-ListImageFiltersTestJSON-1021467922 tempest-ListImageFiltersTestJSON-1021467922-project-member] Enqueued Resource ID: 0defdd0d-cdbe-4a7c-9871-fd4c40a3847e with Priority: HIGHEST for action security_group_members [ 803.540422] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0defdd0d-cdbe-4a7c-9871-fd4c40a3847e with Priority: HIGHEST for action security_group_members [ 803.541128] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 18bb45c8-7cab-44a5-887c-82deb65b8e26 with Priority: HIGH for action security_group_rules [ 803.541128] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9e80329d-1fcd-4c50-8991-a90e2a1fbdbc with Priority: HIGH for action security_group_rules [ 803.541128] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8beaaac6-ba63-44e8-a960-7e228e2e7d37 with Priority: HIGH for action security_group_rules [ 803.541128] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6951f012-9730-40bd-a7af-9b70cd598b05 with Priority: HIGH for action security_group_rules [ 803.541128] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 934be6c8-f61f-4a11-9b02-e48c8e4ae509 with Priority: HIGH for action security_group_rules [ 803.541463] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: df9d38aa-4663-42d9-8451-f5b81969567d with Priority: HIGH for action security_group_rules [ 803.541463] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3d7e63c8-5b54-4e8c-889b-658da24748dc with Priority: HIGH for action security_group_rules [ 803.541541] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3eee5457-701b-405e-bdf2-f055e0150d49 with Priority: HIGH for action security_group_rules [ 803.541744] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 46299e31-1097-4753-8f76-35280209d73c with Priority: HIGH for action security_group_rules [ 803.541851] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 37349b8b-c2c1-4141-8b10-752c27492cbd with Priority: HIGH for action security_group_rules [ 803.541943] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ca47d813-3b19-4aa2-8339-4f933a85963f with Priority: HIGH for action security_group_rules [ 803.542043] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0defdd0d-cdbe-4a7c-9871-fd4c40a3847e with Priority: HIGH for action security_group_rules [ 803.542135] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 70b8bb37-9445-4339-82b5-ebb24bd0be78 with Priority: HIGH for action security_group_rules [ 803.542219] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ef5de9e7-0c3b-4386-af3c-de134eff75f3 with Priority: HIGH for action security_group_rules [ 803.542310] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ed6cda65-baf0-42a6-bcdd-7a946b27c841 with Priority: HIGH for action security_group_rules [ 803.542397] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 41ddc5e2-3eff-4217-8312-ffe238697b2c with Priority: HIGH for action security_group_rules [ 803.542547] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7f0c403f-7209-472e-8592-d169f66791c9 with Priority: HIGH for action security_group_rules [ 803.542717] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a05c132c-ec2c-4f0a-90d8-a619996ad7aa with Priority: HIGH for action security_group_rules [ 803.542815] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 57bb6fe9-98c4-47f0-9daa-c424a0c9dfee with Priority: HIGH for action security_group_rules [ 803.542937] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aceee07e-3675-474c-96e8-9fe510f1356f with Priority: HIGH for action security_group_rules [ 803.543255] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-0defdd0d-cdbe-4a7c-9871-fd4c40a3847e taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.543384] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0defdd0d-cdbe-4a7c-9871-fd4c40a3847e" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.543505] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0defdd0d-cdbe-4a7c-9871-fd4c40a3847e" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.543719] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0defdd0d-cdbe-4a7c-9871-fd4c40a3847e" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.543955] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.544074] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.544139] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.544295] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.544384] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.544584] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0defdd0d-cdbe-4a7c-9871-fd4c40a3847e',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 803.545692] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock rules-18bb45c8-7cab-44a5-887c-82deb65b8e26 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.545692] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-18bb45c8-7cab-44a5-887c-82deb65b8e26" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.545813] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-18bb45c8-7cab-44a5-887c-82deb65b8e26" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.545935] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-18bb45c8-7cab-44a5-887c-82deb65b8e26" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.546044] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('18bb45c8-7cab-44a5-887c-82deb65b8e26',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 803.547127] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9e80329d-1fcd-4c50-8991-a90e2a1fbdbc taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.547127] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9e80329d-1fcd-4c50-8991-a90e2a1fbdbc" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.547251] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9e80329d-1fcd-4c50-8991-a90e2a1fbdbc" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.547374] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9e80329d-1fcd-4c50-8991-a90e2a1fbdbc" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.547453] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9e80329d-1fcd-4c50-8991-a90e2a1fbdbc',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 803.548431] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8beaaac6-ba63-44e8-a960-7e228e2e7d37 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.548549] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8beaaac6-ba63-44e8-a960-7e228e2e7d37" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.548618] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8beaaac6-ba63-44e8-a960-7e228e2e7d37" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.548825] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8beaaac6-ba63-44e8-a960-7e228e2e7d37" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.548862] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8beaaac6-ba63-44e8-a960-7e228e2e7d37',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 803.549939] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6951f012-9730-40bd-a7af-9b70cd598b05 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.550061] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6951f012-9730-40bd-a7af-9b70cd598b05" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.550131] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6951f012-9730-40bd-a7af-9b70cd598b05" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.550320] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6951f012-9730-40bd-a7af-9b70cd598b05" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.550604] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6951f012-9730-40bd-a7af-9b70cd598b05',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 803.551391] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock rules-934be6c8-f61f-4a11-9b02-e48c8e4ae509 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.551524] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-934be6c8-f61f-4a11-9b02-e48c8e4ae509" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.551644] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-934be6c8-f61f-4a11-9b02-e48c8e4ae509" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.551904] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-934be6c8-f61f-4a11-9b02-e48c8e4ae509" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.551904] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('934be6c8-f61f-4a11-9b02-e48c8e4ae509',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 803.552759] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock rules-df9d38aa-4663-42d9-8451-f5b81969567d taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.552861] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-df9d38aa-4663-42d9-8451-f5b81969567d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.552918] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-df9d38aa-4663-42d9-8451-f5b81969567d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.553069] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-df9d38aa-4663-42d9-8451-f5b81969567d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.553223] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('df9d38aa-4663-42d9-8451-f5b81969567d',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 803.554115] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3d7e63c8-5b54-4e8c-889b-658da24748dc taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.554318] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3d7e63c8-5b54-4e8c-889b-658da24748dc" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.554427] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3d7e63c8-5b54-4e8c-889b-658da24748dc" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.554608] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3d7e63c8-5b54-4e8c-889b-658da24748dc" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.554698] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3d7e63c8-5b54-4e8c-889b-658da24748dc',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 803.555540] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3eee5457-701b-405e-bdf2-f055e0150d49 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.555635] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3eee5457-701b-405e-bdf2-f055e0150d49" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.555756] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3eee5457-701b-405e-bdf2-f055e0150d49" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.555851] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3eee5457-701b-405e-bdf2-f055e0150d49" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.555924] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3eee5457-701b-405e-bdf2-f055e0150d49',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 803.557137] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock rules-46299e31-1097-4753-8f76-35280209d73c taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.557266] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-46299e31-1097-4753-8f76-35280209d73c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.557378] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-46299e31-1097-4753-8f76-35280209d73c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.557601] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-46299e31-1097-4753-8f76-35280209d73c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.557706] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('46299e31-1097-4753-8f76-35280209d73c',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 803.558076] env[65306]: WARNING oslo_messaging._drivers.amqpdriver [-] Number of call queues is 11, greater than warning threshold: 10. There could be a leak. Increasing threshold to: 20 [ 803.559146] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock rules-37349b8b-c2c1-4141-8b10-752c27492cbd taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.559300] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-37349b8b-c2c1-4141-8b10-752c27492cbd" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.559398] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-37349b8b-c2c1-4141-8b10-752c27492cbd" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.559554] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-37349b8b-c2c1-4141-8b10-752c27492cbd" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.559629] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('37349b8b-c2c1-4141-8b10-752c27492cbd',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 803.560579] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ca47d813-3b19-4aa2-8339-4f933a85963f taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.560727] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ca47d813-3b19-4aa2-8339-4f933a85963f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.560782] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ca47d813-3b19-4aa2-8339-4f933a85963f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.560954] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ca47d813-3b19-4aa2-8339-4f933a85963f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.561012] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ca47d813-3b19-4aa2-8339-4f933a85963f',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 803.562202] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0defdd0d-cdbe-4a7c-9871-fd4c40a3847e taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.564154] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0defdd0d-cdbe-4a7c-9871-fd4c40a3847e" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.564154] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0defdd0d-cdbe-4a7c-9871-fd4c40a3847e" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.564154] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0defdd0d-cdbe-4a7c-9871-fd4c40a3847e" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.564154] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0defdd0d-cdbe-4a7c-9871-fd4c40a3847e',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 803.571608] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock rules-70b8bb37-9445-4339-82b5-ebb24bd0be78 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.571608] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-70b8bb37-9445-4339-82b5-ebb24bd0be78" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.571608] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-70b8bb37-9445-4339-82b5-ebb24bd0be78" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.571608] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-70b8bb37-9445-4339-82b5-ebb24bd0be78" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.571608] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('70b8bb37-9445-4339-82b5-ebb24bd0be78',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 803.571608] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ef5de9e7-0c3b-4386-af3c-de134eff75f3 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.571608] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ef5de9e7-0c3b-4386-af3c-de134eff75f3" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.571608] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ef5de9e7-0c3b-4386-af3c-de134eff75f3" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.571608] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ef5de9e7-0c3b-4386-af3c-de134eff75f3" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.571608] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ef5de9e7-0c3b-4386-af3c-de134eff75f3',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 803.571608] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ed6cda65-baf0-42a6-bcdd-7a946b27c841 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.571608] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ed6cda65-baf0-42a6-bcdd-7a946b27c841" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.571608] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ed6cda65-baf0-42a6-bcdd-7a946b27c841" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.571608] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ed6cda65-baf0-42a6-bcdd-7a946b27c841" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.571608] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ed6cda65-baf0-42a6-bcdd-7a946b27c841',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 803.576833] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock rules-41ddc5e2-3eff-4217-8312-ffe238697b2c taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.576962] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-41ddc5e2-3eff-4217-8312-ffe238697b2c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.577268] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7f0c403f-7209-472e-8592-d169f66791c9 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.577392] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7f0c403f-7209-472e-8592-d169f66791c9" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.577455] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7f0c403f-7209-472e-8592-d169f66791c9" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.577660] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7f0c403f-7209-472e-8592-d169f66791c9" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.577782] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7f0c403f-7209-472e-8592-d169f66791c9',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 803.579059] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a05c132c-ec2c-4f0a-90d8-a619996ad7aa taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.579180] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a05c132c-ec2c-4f0a-90d8-a619996ad7aa" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.579300] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a05c132c-ec2c-4f0a-90d8-a619996ad7aa" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.579528] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a05c132c-ec2c-4f0a-90d8-a619996ad7aa" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.579626] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a05c132c-ec2c-4f0a-90d8-a619996ad7aa',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 803.585942] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock rules-57bb6fe9-98c4-47f0-9daa-c424a0c9dfee taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.586137] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-57bb6fe9-98c4-47f0-9daa-c424a0c9dfee" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.586137] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-57bb6fe9-98c4-47f0-9daa-c424a0c9dfee" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.586883] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-57bb6fe9-98c4-47f0-9daa-c424a0c9dfee" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.586883] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('57bb6fe9-98c4-47f0-9daa-c424a0c9dfee',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 803.587859] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock rules-aceee07e-3675-474c-96e8-9fe510f1356f taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.589362] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-aceee07e-3675-474c-96e8-9fe510f1356f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.589362] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-aceee07e-3675-474c-96e8-9fe510f1356f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.589362] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-aceee07e-3675-474c-96e8-9fe510f1356f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.590598] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('aceee07e-3675-474c-96e8-9fe510f1356f',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 803.590598] env[65306]: WARNING oslo_messaging._drivers.amqpdriver [-] Number of call queues is 21, greater than warning threshold: 20. There could be a leak. Increasing threshold to: 40 [ 803.933149] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.933149] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.933149] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.933149] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.957037] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.957097] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 41ddc5e2-3eff-4217-8312-ffe238697b2c is going to be deleted. [ 804.027956] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.027956] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.027956] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.027956] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.027956] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.027956] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-41ddc5e2-3eff-4217-8312-ffe238697b2c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.028349] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-41ddc5e2-3eff-4217-8312-ffe238697b2c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.028349] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-41ddc5e2-3eff-4217-8312-ffe238697b2c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.028412] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('41ddc5e2-3eff-4217-8312-ffe238697b2c',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 804.053178] env[65306]: INFO networking_nsxv3.common.synchronization [req-261c21c3-ad52-42c3-be66-8b186ed2abf3 req-9c2fbfb2-41e4-46bc-9985-90d81b642b9c tempest-ServersV294TestFqdnHostnames-853342652 tempest-ServersV294TestFqdnHostnames-853342652-project-member] Enqueued Resource ID: 18bb45c8-7cab-44a5-887c-82deb65b8e26 with Priority: HIGHEST for action security_group_members [ 804.054861] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 18bb45c8-7cab-44a5-887c-82deb65b8e26 with Priority: HIGHEST for action security_group_members [ 804.055518] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-18bb45c8-7cab-44a5-887c-82deb65b8e26 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.058539] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-18bb45c8-7cab-44a5-887c-82deb65b8e26" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.058539] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-18bb45c8-7cab-44a5-887c-82deb65b8e26" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.058539] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-18bb45c8-7cab-44a5-887c-82deb65b8e26" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.058539] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.058539] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.058539] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.058539] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.058539] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.058539] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('18bb45c8-7cab-44a5-887c-82deb65b8e26',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 804.094607] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-18bb45c8-7cab-44a5-887c-82deb65b8e26 taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.094607] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-18bb45c8-7cab-44a5-887c-82deb65b8e26" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.094607] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0defdd0d-cdbe-4a7c-9871-fd4c40a3847e',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 804.094607] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-9e80329d-1fcd-4c50-8991-a90e2a1fbdbc taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.094607] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9e80329d-1fcd-4c50-8991-a90e2a1fbdbc" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.094607] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9e80329d-1fcd-4c50-8991-a90e2a1fbdbc" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.095147] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9e80329d-1fcd-4c50-8991-a90e2a1fbdbc" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.095649] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.095817] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.095903] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.096110] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.096212] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.096338] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9e80329d-1fcd-4c50-8991-a90e2a1fbdbc" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.096552] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9e80329d-1fcd-4c50-8991-a90e2a1fbdbc',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 804.142956] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-ef5de9e7-0c3b-4386-af3c-de134eff75f3 taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.143075] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ef5de9e7-0c3b-4386-af3c-de134eff75f3" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.143125] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ef5de9e7-0c3b-4386-af3c-de134eff75f3" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.144970] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ef5de9e7-0c3b-4386-af3c-de134eff75f3" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.144970] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.144970] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.144970] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.144970] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.144970] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.144970] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ef5de9e7-0c3b-4386-af3c-de134eff75f3" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.144970] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ef5de9e7-0c3b-4386-af3c-de134eff75f3',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 804.145430] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-57bb6fe9-98c4-47f0-9daa-c424a0c9dfee taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.145430] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-57bb6fe9-98c4-47f0-9daa-c424a0c9dfee" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.145430] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-57bb6fe9-98c4-47f0-9daa-c424a0c9dfee" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.145430] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-57bb6fe9-98c4-47f0-9daa-c424a0c9dfee" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.145593] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.145639] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.146092] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.146092] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.146092] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.146092] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-57bb6fe9-98c4-47f0-9daa-c424a0c9dfee" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.146272] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('57bb6fe9-98c4-47f0-9daa-c424a0c9dfee',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 804.147080] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-7f0c403f-7209-472e-8592-d169f66791c9 taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.147186] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7f0c403f-7209-472e-8592-d169f66791c9" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.147234] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7f0c403f-7209-472e-8592-d169f66791c9" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.147358] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7f0c403f-7209-472e-8592-d169f66791c9" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.147497] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.148584] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.148584] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.148584] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.148584] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.148584] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7f0c403f-7209-472e-8592-d169f66791c9" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.148584] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7f0c403f-7209-472e-8592-d169f66791c9',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 804.151563] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-ca47d813-3b19-4aa2-8339-4f933a85963f taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.151661] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ca47d813-3b19-4aa2-8339-4f933a85963f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.151718] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ca47d813-3b19-4aa2-8339-4f933a85963f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.151883] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ca47d813-3b19-4aa2-8339-4f933a85963f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.152053] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.152138] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.152199] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.152606] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.152606] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.152606] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ca47d813-3b19-4aa2-8339-4f933a85963f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.152606] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ca47d813-3b19-4aa2-8339-4f933a85963f',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 804.155641] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-0defdd0d-cdbe-4a7c-9871-fd4c40a3847e taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.156827] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0defdd0d-cdbe-4a7c-9871-fd4c40a3847e" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.157829] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-37349b8b-c2c1-4141-8b10-752c27492cbd taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.158068] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-37349b8b-c2c1-4141-8b10-752c27492cbd" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.158068] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-37349b8b-c2c1-4141-8b10-752c27492cbd" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.158682] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-37349b8b-c2c1-4141-8b10-752c27492cbd" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.158682] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.158682] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.158682] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.158888] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.158888] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.158888] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-37349b8b-c2c1-4141-8b10-752c27492cbd" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.158995] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('37349b8b-c2c1-4141-8b10-752c27492cbd',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 804.172775] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-8beaaac6-ba63-44e8-a960-7e228e2e7d37 taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.172775] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8beaaac6-ba63-44e8-a960-7e228e2e7d37" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.172775] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8beaaac6-ba63-44e8-a960-7e228e2e7d37" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.172775] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8beaaac6-ba63-44e8-a960-7e228e2e7d37" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.173106] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.173106] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.173106] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.173211] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.173291] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.177152] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8beaaac6-ba63-44e8-a960-7e228e2e7d37" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.177384] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8beaaac6-ba63-44e8-a960-7e228e2e7d37',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 804.179109] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-3eee5457-701b-405e-bdf2-f055e0150d49 taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.179109] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3eee5457-701b-405e-bdf2-f055e0150d49" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.179109] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3eee5457-701b-405e-bdf2-f055e0150d49" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.179109] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3eee5457-701b-405e-bdf2-f055e0150d49" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.179109] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.179109] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.179109] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.179632] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.179632] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.179632] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3eee5457-701b-405e-bdf2-f055e0150d49" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.179632] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3eee5457-701b-405e-bdf2-f055e0150d49',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 804.217443] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.217635] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.217878] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.218165] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.222367] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.222529] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.223617] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.223776] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.224643] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.225726] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.226050] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.227032] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.229436] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.229558] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.230368] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.230524] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.231203] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.231320] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.232067] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.232164] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.246164] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.246407] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 70b8bb37-9445-4339-82b5-ebb24bd0be78 is going to be deleted. [ 804.249489] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.250337] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.271516] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.271682] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ed6cda65-baf0-42a6-bcdd-7a946b27c841 is going to be deleted. [ 804.272722] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.274748] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.304080] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.304080] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 934be6c8-f61f-4a11-9b02-e48c8e4ae509 is going to be deleted. [ 804.304080] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.306357] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.306357] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.306357] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.327814] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.328039] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: aceee07e-3675-474c-96e8-9fe510f1356f is going to be deleted. [ 804.329254] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.329592] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.329753] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.329868] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3d7e63c8-5b54-4e8c-889b-658da24748dc is going to be deleted. [ 804.331732] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.331956] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.338557] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.338773] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.351806] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.352853] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a05c132c-ec2c-4f0a-90d8-a619996ad7aa is going to be deleted. [ 804.353081] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.353386] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.382949] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.383326] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 46299e31-1097-4753-8f76-35280209d73c is going to be deleted. [ 804.384382] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.384622] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.386205] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.386294] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.406594] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.407363] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.441996] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.442297] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.444207] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.444207] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.472307] env[65306]: INFO networking_nsxv3.common.synchronization [req-8c52d494-2636-4a35-96f0-76a9ef947cfc req-cb38a39c-5889-4b56-8a26-2cccab398bbb tempest-InstanceActionsTestJSON-1096187469 tempest-InstanceActionsTestJSON-1096187469-project-member] Enqueued Resource ID: c3a4b03d-2231-4b42-a522-be404c2784e5 with Priority: HIGHEST for action security_group_members [ 804.472964] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c3a4b03d-2231-4b42-a522-be404c2784e5 with Priority: HIGHEST for action security_group_members [ 804.473398] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-c3a4b03d-2231-4b42-a522-be404c2784e5 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.473550] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c3a4b03d-2231-4b42-a522-be404c2784e5" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.473623] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c3a4b03d-2231-4b42-a522-be404c2784e5" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.473840] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c3a4b03d-2231-4b42-a522-be404c2784e5" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.473999] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.474197] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.474319] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.474533] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.474627] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.474728] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c3a4b03d-2231-4b42-a522-be404c2784e5',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 804.476400] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.476518] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6951f012-9730-40bd-a7af-9b70cd598b05 is going to be deleted. [ 804.477865] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.478393] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.524988] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.525199] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.540178] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.540387] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: df9d38aa-4663-42d9-8451-f5b81969567d is going to be deleted. [ 804.542465] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.542694] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.542777] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.542904] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-70b8bb37-9445-4339-82b5-ebb24bd0be78" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.543428] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.543630] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.543713] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.543835] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ed6cda65-baf0-42a6-bcdd-7a946b27c841" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.544653] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.544948] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.544948] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.545138] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-934be6c8-f61f-4a11-9b02-e48c8e4ae509" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.545348] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.545593] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.545690] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.545958] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-aceee07e-3675-474c-96e8-9fe510f1356f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.546155] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.546362] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.546455] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.546575] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3d7e63c8-5b54-4e8c-889b-658da24748dc" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.546930] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.546930] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.547040] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.547148] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a05c132c-ec2c-4f0a-90d8-a619996ad7aa" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.547297] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.547823] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.547823] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.547823] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-46299e31-1097-4753-8f76-35280209d73c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.562177] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.562177] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.562177] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.562177] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.599386] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-9e80329d-1fcd-4c50-8991-a90e2a1fbdbc taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.599564] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9e80329d-1fcd-4c50-8991-a90e2a1fbdbc" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.599618] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9e80329d-1fcd-4c50-8991-a90e2a1fbdbc" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.600205] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9e80329d-1fcd-4c50-8991-a90e2a1fbdbc" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.600205] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.600205] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.600205] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.600468] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.602224] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.602224] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9e80329d-1fcd-4c50-8991-a90e2a1fbdbc" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.602224] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-9e80329d-1fcd-4c50-8991-a90e2a1fbdbc taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.602224] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9e80329d-1fcd-4c50-8991-a90e2a1fbdbc" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.602224] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9e80329d-1fcd-4c50-8991-a90e2a1fbdbc" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.602224] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9e80329d-1fcd-4c50-8991-a90e2a1fbdbc" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.602224] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.602224] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.602224] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.602224] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.602224] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.602224] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9e80329d-1fcd-4c50-8991-a90e2a1fbdbc" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.602224] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9e80329d-1fcd-4c50-8991-a90e2a1fbdbc',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 804.604189] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.604413] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.604733] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0defdd0d-cdbe-4a7c-9871-fd4c40a3847e',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 804.621233] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.621503] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.621626] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.621694] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.621911] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.621996] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.622103] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 18bb45c8-7cab-44a5-887c-82deb65b8e26 is going to be updated. [ 804.623128] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.623315] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.623407] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.623500] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 41ddc5e2-3eff-4217-8312-ffe238697b2c already deleted. [ 804.623586] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-41ddc5e2-3eff-4217-8312-ffe238697b2c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.790833] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.791047] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.791047] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.792851] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.792851] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.792851] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-df9d38aa-4663-42d9-8451-f5b81969567d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.792851] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.792851] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.792851] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.793210] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.793210] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.794956] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.795129] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.795170] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.795363] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.795444] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.795563] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6951f012-9730-40bd-a7af-9b70cd598b05" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.795785] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ca47d813-3b19-4aa2-8339-4f933a85963f',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 804.796734] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7f0c403f-7209-472e-8592-d169f66791c9',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 804.797486] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ef5de9e7-0c3b-4386-af3c-de134eff75f3',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 804.798272] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-57bb6fe9-98c4-47f0-9daa-c424a0c9dfee taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.798395] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-57bb6fe9-98c4-47f0-9daa-c424a0c9dfee" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.798459] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-57bb6fe9-98c4-47f0-9daa-c424a0c9dfee" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.798654] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-57bb6fe9-98c4-47f0-9daa-c424a0c9dfee" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.798805] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.798899] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.798957] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.799114] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.799193] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.799274] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-57bb6fe9-98c4-47f0-9daa-c424a0c9dfee" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.799417] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-57bb6fe9-98c4-47f0-9daa-c424a0c9dfee taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.799500] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-57bb6fe9-98c4-47f0-9daa-c424a0c9dfee" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.799556] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-57bb6fe9-98c4-47f0-9daa-c424a0c9dfee" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.799684] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-57bb6fe9-98c4-47f0-9daa-c424a0c9dfee" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.799812] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.800132] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.800132] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.800132] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.800291] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.800291] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-57bb6fe9-98c4-47f0-9daa-c424a0c9dfee" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.800432] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('57bb6fe9-98c4-47f0-9daa-c424a0c9dfee',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 804.801151] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-8beaaac6-ba63-44e8-a960-7e228e2e7d37 taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.801262] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8beaaac6-ba63-44e8-a960-7e228e2e7d37" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.801311] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8beaaac6-ba63-44e8-a960-7e228e2e7d37" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.801857] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8beaaac6-ba63-44e8-a960-7e228e2e7d37" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.801857] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.801857] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.801857] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.802048] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.802048] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.803323] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8beaaac6-ba63-44e8-a960-7e228e2e7d37" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.803323] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-8beaaac6-ba63-44e8-a960-7e228e2e7d37 taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.803323] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8beaaac6-ba63-44e8-a960-7e228e2e7d37" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.803323] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8beaaac6-ba63-44e8-a960-7e228e2e7d37" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.803323] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8beaaac6-ba63-44e8-a960-7e228e2e7d37" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.803323] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.803323] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.803323] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.803323] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.803323] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.803323] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8beaaac6-ba63-44e8-a960-7e228e2e7d37" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.803323] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8beaaac6-ba63-44e8-a960-7e228e2e7d37',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 804.804748] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-3eee5457-701b-405e-bdf2-f055e0150d49 taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.804748] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3eee5457-701b-405e-bdf2-f055e0150d49" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.804748] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3eee5457-701b-405e-bdf2-f055e0150d49" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.804748] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3eee5457-701b-405e-bdf2-f055e0150d49" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.804748] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.804932] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.804932] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.805053] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.805095] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.805153] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3eee5457-701b-405e-bdf2-f055e0150d49" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.805288] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-3eee5457-701b-405e-bdf2-f055e0150d49 taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.805371] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3eee5457-701b-405e-bdf2-f055e0150d49" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.805435] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3eee5457-701b-405e-bdf2-f055e0150d49" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.805552] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3eee5457-701b-405e-bdf2-f055e0150d49" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.805675] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.805757] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.805812] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.805938] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.806019] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.806167] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3eee5457-701b-405e-bdf2-f055e0150d49" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.806167] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3eee5457-701b-405e-bdf2-f055e0150d49',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 804.807413] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('37349b8b-c2c1-4141-8b10-752c27492cbd',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 804.831025] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 18bb45c8-7cab-44a5-887c-82deb65b8e26 in Status: IN_PROGRESS for 2s [ 804.854700] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3d7e63c8-5b54-4e8c-889b-658da24748dc in Status: SUCCESS [ 804.854912] env[65306]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3d7e63c8-5b54-4e8c-889b-658da24748dc deletion is rescheduled due to dependency. [ 804.855062] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3d7e63c8-5b54-4e8c-889b-658da24748dc" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.981176] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.981361] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.981418] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.982323] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.011566] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.011566] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.011566] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.011566] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.011566] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.011566] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.011566] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c3a4b03d-2231-4b42-a522-be404c2784e5 is going to be updated. [ 805.075727] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.076112] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.076250] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.076874] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.077067] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.090851] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c3a4b03d-2231-4b42-a522-be404c2784e5 in Status: IN_PROGRESS for 2s [ 805.106457] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9e80329d-1fcd-4c50-8991-a90e2a1fbdbc: rpc.has_security_group_logging(os_id): False [ 805.108019] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.108019] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.108206] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.108345] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.108422] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.108529] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0defdd0d-cdbe-4a7c-9871-fd4c40a3847e is going to be updated. [ 805.131980] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.131980] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.131980] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.132321] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.147773] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.147945] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.148027] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.149047] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.149047] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.157721] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.160147] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.160147] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.160147] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.160147] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.160147] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.160147] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.160147] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.160147] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.160147] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.160147] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.160147] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.160147] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.160147] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.160739] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.160739] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.160739] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9e80329d-1fcd-4c50-8991-a90e2a1fbdbc is going to be updated. [ 805.163372] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0defdd0d-cdbe-4a7c-9871-fd4c40a3847e in Status: IN_PROGRESS for 2s [ 805.269679] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.270229] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.270360] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.270665] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.270880] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.300441] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9e80329d-1fcd-4c50-8991-a90e2a1fbdbc in Status: IN_PROGRESS for 2s [ 805.312548] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ef5de9e7-0c3b-4386-af3c-de134eff75f3: rpc.has_security_group_logging(os_id): False [ 805.319038] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7f0c403f-7209-472e-8592-d169f66791c9: rpc.has_security_group_logging(os_id): False [ 805.319038] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ca47d813-3b19-4aa2-8339-4f933a85963f: rpc.has_security_group_logging(os_id): False [ 805.319038] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 37349b8b-c2c1-4141-8b10-752c27492cbd: rpc.has_security_group_logging(os_id): False [ 805.319038] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 57bb6fe9-98c4-47f0-9daa-c424a0c9dfee: rpc.has_security_group_logging(os_id): False [ 805.319038] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8beaaac6-ba63-44e8-a960-7e228e2e7d37: rpc.has_security_group_logging(os_id): False [ 805.319475] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3eee5457-701b-405e-bdf2-f055e0150d49: rpc.has_security_group_logging(os_id): False [ 805.362358] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.363477] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.363571] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.363819] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.386878] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.387212] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.394294] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.394294] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.394294] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.394934] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.396238] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.396507] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.398258] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.399357] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.399357] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.400557] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.407953] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.408497] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.408643] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.408699] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.408866] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.408949] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.409067] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 37349b8b-c2c1-4141-8b10-752c27492cbd is going to be updated. [ 805.411791] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.412069] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.459168] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.459168] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.459168] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.459168] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.459168] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.459168] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.459168] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7f0c403f-7209-472e-8592-d169f66791c9 is going to be updated. [ 805.464966] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.464966] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.487525] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.488528] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.488528] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.488528] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.488528] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.488528] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.488860] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.489279] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.489279] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.489447] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.489536] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.489866] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.489993] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.490110] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.490452] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.490545] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.490677] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8beaaac6-ba63-44e8-a960-7e228e2e7d37 is going to be updated. [ 805.492475] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.492865] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.523090] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.523282] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.524532] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.524532] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.524661] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.524661] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.524922] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.524922] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.525113] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.525192] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.525254] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.525434] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.525545] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.525808] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.525937] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.529869] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.530554] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.530554] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.530554] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3eee5457-701b-405e-bdf2-f055e0150d49 is going to be updated. [ 805.532168] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.532168] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.539130] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.539130] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.559779] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.560125] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.560288] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.560390] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.560642] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.560642] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.560726] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ca47d813-3b19-4aa2-8339-4f933a85963f is going to be updated. [ 805.561791] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.561948] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.567243] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.567243] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.615879] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.616130] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.616242] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.616313] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.616514] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.616607] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.616737] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ef5de9e7-0c3b-4386-af3c-de134eff75f3 is going to be updated. [ 805.617916] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.618113] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.641070] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.641221] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.664744] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.665055] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.665196] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.665265] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.665466] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.665551] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.665752] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.665854] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.665918] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.666076] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.666148] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.666334] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.666456] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.666497] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.666613] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.666687] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.666779] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 57bb6fe9-98c4-47f0-9daa-c424a0c9dfee is going to be updated. [ 805.668283] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.668450] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.668692] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.669558] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.669721] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.669864] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.670807] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.670971] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.671110] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.671919] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.672089] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.672214] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.696134] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.696557] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.702287] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.702287] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.702287] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.727015] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8beaaac6-ba63-44e8-a960-7e228e2e7d37 in Status: IN_PROGRESS for 2s [ 805.727393] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 37349b8b-c2c1-4141-8b10-752c27492cbd in Status: IN_PROGRESS for 2s [ 805.728255] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3eee5457-701b-405e-bdf2-f055e0150d49 in Status: IN_PROGRESS for 2s [ 805.728968] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7f0c403f-7209-472e-8592-d169f66791c9 in Status: IN_PROGRESS for 2s [ 805.734419] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ca47d813-3b19-4aa2-8339-4f933a85963f in Status: IN_PROGRESS for 2s [ 805.784258] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.784454] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.784554] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.784964] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.785174] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.801888] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ef5de9e7-0c3b-4386-af3c-de134eff75f3 in Status: IN_PROGRESS for 2s [ 805.838527] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.838527] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.838527] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.838527] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.838527] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.858824] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 57bb6fe9-98c4-47f0-9daa-c424a0c9dfee in Status: IN_PROGRESS for 2s [ 806.841586] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 18bb45c8-7cab-44a5-887c-82deb65b8e26 in Status: SUCCESS [ 806.841852] env[65306]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 18bb45c8-7cab-44a5-887c-82deb65b8e26 deletion is rescheduled due to dependency. [ 806.841891] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-18bb45c8-7cab-44a5-887c-82deb65b8e26" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.842065] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-18bb45c8-7cab-44a5-887c-82deb65b8e26" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.842307] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-18bb45c8-7cab-44a5-887c-82deb65b8e26" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.842511] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.842889] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.842889] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.842889] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.843031] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.843065] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-18bb45c8-7cab-44a5-887c-82deb65b8e26" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.843136] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('18bb45c8-7cab-44a5-887c-82deb65b8e26',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 807.102324] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c3a4b03d-2231-4b42-a522-be404c2784e5 in Status: SUCCESS [ 807.102324] env[65306]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c3a4b03d-2231-4b42-a522-be404c2784e5 deletion is rescheduled due to dependency. [ 807.102324] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c3a4b03d-2231-4b42-a522-be404c2784e5" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.175724] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0defdd0d-cdbe-4a7c-9871-fd4c40a3847e in Status: SUCCESS [ 807.175724] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0defdd0d-cdbe-4a7c-9871-fd4c40a3847e" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.177014] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0defdd0d-cdbe-4a7c-9871-fd4c40a3847e" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.177014] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0defdd0d-cdbe-4a7c-9871-fd4c40a3847e" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.177014] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.177014] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.177014] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.177014] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.177014] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.178030] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0defdd0d-cdbe-4a7c-9871-fd4c40a3847e" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.178030] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0defdd0d-cdbe-4a7c-9871-fd4c40a3847e',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 807.314660] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9e80329d-1fcd-4c50-8991-a90e2a1fbdbc in Status: SUCCESS [ 807.314874] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9e80329d-1fcd-4c50-8991-a90e2a1fbdbc" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.348153] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('18bb45c8-7cab-44a5-887c-82deb65b8e26',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 807.654838] env[65306]: INFO networking_nsxv3.common.synchronization [None req-215f8a66-ef95-47f1-baa1-eb7c55c16e00 None None] Enqueued Resource ID: bae934e7-402e-4983-982e-fcd283ec4f81 with Priority: HIGHEST for action port [ 807.655408] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bae934e7-402e-4983-982e-fcd283ec4f81 with Priority: HIGHEST for action port [ 807.655723] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock port-bae934e7-402e-4983-982e-fcd283ec4f81 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.655840] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bae934e7-402e-4983-982e-fcd283ec4f81" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.655909] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bae934e7-402e-4983-982e-fcd283ec4f81" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.656967] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bae934e7-402e-4983-982e-fcd283ec4f81" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.657650] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bae934e7-402e-4983-982e-fcd283ec4f81',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 807.681539] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-0defdd0d-cdbe-4a7c-9871-fd4c40a3847e taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.681697] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0defdd0d-cdbe-4a7c-9871-fd4c40a3847e" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.681763] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0defdd0d-cdbe-4a7c-9871-fd4c40a3847e" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.681979] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0defdd0d-cdbe-4a7c-9871-fd4c40a3847e" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.682151] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.682440] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.682440] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.682540] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.682540] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.682618] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0defdd0d-cdbe-4a7c-9871-fd4c40a3847e" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.683516] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-0defdd0d-cdbe-4a7c-9871-fd4c40a3847e taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.683516] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0defdd0d-cdbe-4a7c-9871-fd4c40a3847e" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.683516] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0defdd0d-cdbe-4a7c-9871-fd4c40a3847e" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.683516] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0defdd0d-cdbe-4a7c-9871-fd4c40a3847e" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.683516] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.683516] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.683516] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.683516] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.683516] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.684051] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0defdd0d-cdbe-4a7c-9871-fd4c40a3847e" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.684051] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0defdd0d-cdbe-4a7c-9871-fd4c40a3847e',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 807.751609] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7f0c403f-7209-472e-8592-d169f66791c9 in Status: SUCCESS [ 807.751831] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7f0c403f-7209-472e-8592-d169f66791c9" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.753382] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ca47d813-3b19-4aa2-8339-4f933a85963f in Status: SUCCESS [ 807.753588] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ca47d813-3b19-4aa2-8339-4f933a85963f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.754362] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3eee5457-701b-405e-bdf2-f055e0150d49 in Status: SUCCESS [ 807.754624] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3eee5457-701b-405e-bdf2-f055e0150d49" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.755272] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8beaaac6-ba63-44e8-a960-7e228e2e7d37 in Status: SUCCESS [ 807.755514] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8beaaac6-ba63-44e8-a960-7e228e2e7d37" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.756157] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 37349b8b-c2c1-4141-8b10-752c27492cbd in Status: SUCCESS [ 807.756912] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-37349b8b-c2c1-4141-8b10-752c27492cbd" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.815473] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ef5de9e7-0c3b-4386-af3c-de134eff75f3 in Status: SUCCESS [ 807.815739] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ef5de9e7-0c3b-4386-af3c-de134eff75f3" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.851988] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 18bb45c8-7cab-44a5-887c-82deb65b8e26: rpc.has_security_group_logging(os_id): False [ 807.870562] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 57bb6fe9-98c4-47f0-9daa-c424a0c9dfee in Status: SUCCESS [ 807.870815] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-57bb6fe9-98c4-47f0-9daa-c424a0c9dfee" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.871917] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.872083] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.872180] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.872412] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.872514] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.872810] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.872924] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.872994] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.873328] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.873328] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.873411] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 18bb45c8-7cab-44a5-887c-82deb65b8e26 is going to be updated. [ 808.013038] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.013207] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.013381] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.013580] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.013701] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.032234] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 18bb45c8-7cab-44a5-887c-82deb65b8e26 in Status: IN_PROGRESS for 2s [ 808.161885] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port bae934e7-402e-4983-982e-fcd283ec4f81 [ 808.161885] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.161885] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.161885] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.163470] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.163525] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.163606] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:bae934e7-402e-4983-982e-fcd283ec4f81 already deleted. [ 808.163711] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bae934e7-402e-4983-982e-fcd283ec4f81" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.185832] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0defdd0d-cdbe-4a7c-9871-fd4c40a3847e: rpc.has_security_group_logging(os_id): False [ 808.206828] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.206828] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.207046] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.207557] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.232114] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.232380] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.232503] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.232568] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.232781] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.232864] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.233083] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.233185] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.233247] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.233395] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.233489] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.233690] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.233785] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.233847] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.233989] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.234709] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.234849] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0defdd0d-cdbe-4a7c-9871-fd4c40a3847e is going to be updated. [ 808.306401] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.306545] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.306616] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.306819] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.310023] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.325179] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0defdd0d-cdbe-4a7c-9871-fd4c40a3847e in Status: IN_PROGRESS for 2s [ 808.958036] env[65306]: INFO networking_nsxv3.common.synchronization [req-1fac258f-b672-4392-a054-568a27354d14 req-27aa8ee8-8a06-4295-8241-a55264c880e6 tempest-ServersTestBootFromVolume-1537688806 tempest-ServersTestBootFromVolume-1537688806-project-member] Enqueued Resource ID: c3ffb1bc-84c3-4121-a677-8d413e70c9cc with Priority: HIGHEST for action security_group_members [ 808.958936] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c3ffb1bc-84c3-4121-a677-8d413e70c9cc with Priority: HIGHEST for action security_group_members [ 808.959255] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-c3ffb1bc-84c3-4121-a677-8d413e70c9cc taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.959255] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c3ffb1bc-84c3-4121-a677-8d413e70c9cc" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.959255] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c3ffb1bc-84c3-4121-a677-8d413e70c9cc" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.959522] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c3ffb1bc-84c3-4121-a677-8d413e70c9cc" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.959690] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.959792] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.959855] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.960020] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.960101] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.960204] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c3ffb1bc-84c3-4121-a677-8d413e70c9cc',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.339973] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock network-804 taken with stack trace [, , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.339973] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "network-804" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.339973] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "network-804" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.340378] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "network-804" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.340727] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.340904] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.341038] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.341269] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.341417] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.341659] env[65306]: DEBUG dogpile.cache.region [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] No value present for key: 'zone-id' {{(pid=65306) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 809.341719] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] NeedRegenerationException {{(pid=65306) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 809.341828] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] no value, waiting for create lock {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 809.341933] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] value creation lock acquired {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 809.342050] env[65306]: DEBUG dogpile.cache.region [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] No value present for key: 'zone-id' {{(pid=65306) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 809.342159] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Calling creation function for not-yet-present value {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 809.342288] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 809.362691] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 809.362849] env[65306]: DEBUG dogpile.cache.region [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65306) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 809.362935] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Released creation lock {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 809.363114] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "network-804" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.363429] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock port-1329df5b-3a32-4c08-9b74-227326e87385 taken with stack trace [, , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.363592] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "port-1329df5b-3a32-4c08-9b74-227326e87385" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.363722] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "port-1329df5b-3a32-4c08-9b74-227326e87385" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.364016] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "port-1329df5b-3a32-4c08-9b74-227326e87385" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.364160] env[65306]: DEBUG networking_nsxv3.api.rpc [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1329df5b-3a32-4c08-9b74-227326e87385',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.463975] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.463975] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.465727] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.465727] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.465727] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.465727] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.465727] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.465727] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.465727] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.465727] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.465727] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c3ffb1bc-84c3-4121-a677-8d413e70c9cc already deleted. [ 809.465727] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c3ffb1bc-84c3-4121-a677-8d413e70c9cc" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.793585] env[65306]: INFO networking_nsxv3.common.synchronization [None req-b58773e7-6bc9-442b-9fae-971af5ca959d None None] Enqueued Resource ID: d32c421e-531c-4d55-9fca-ba5edd4bc944 with Priority: HIGHEST for action port [ 809.794312] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d32c421e-531c-4d55-9fca-ba5edd4bc944 with Priority: HIGHEST for action port [ 809.794998] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock port-d32c421e-531c-4d55-9fca-ba5edd4bc944 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.795779] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d32c421e-531c-4d55-9fca-ba5edd4bc944" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.795779] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d32c421e-531c-4d55-9fca-ba5edd4bc944" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.796853] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d32c421e-531c-4d55-9fca-ba5edd4bc944" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.796853] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d32c421e-531c-4d55-9fca-ba5edd4bc944',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.866411] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.866707] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.866854] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.867280] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.867420] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.867611] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Segment Port 1329df5b-3a32-4c08-9b74-227326e87385 not found, creating... [ 809.867924] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.868148] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.868290] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.868771] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.868771] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.869110] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.869300] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.869454] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.869710] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.869884] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.870208] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Resource: SegmentPort with ID: 1329df5b-3a32-4c08-9b74-227326e87385 is going to be created. [ 809.881711] env[65306]: INFO networking_nsxv3.common.synchronization [None req-54233e8d-f4ef-41ea-9644-7c02368624dc None None] Enqueued Resource ID: 6a05f1c7-a743-446b-8d2d-bb7d910c25ee with Priority: HIGHEST for action port [ 809.882982] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6a05f1c7-a743-446b-8d2d-bb7d910c25ee with Priority: HIGHEST for action port [ 809.883436] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock port-6a05f1c7-a743-446b-8d2d-bb7d910c25ee taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.883436] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6a05f1c7-a743-446b-8d2d-bb7d910c25ee" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.883592] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6a05f1c7-a743-446b-8d2d-bb7d910c25ee" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.883743] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6a05f1c7-a743-446b-8d2d-bb7d910c25ee" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.883828] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6a05f1c7-a743-446b-8d2d-bb7d910c25ee',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.898378] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.898849] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.898984] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.899310] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.899638] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.900692] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "port-1329df5b-3a32-4c08-9b74-227326e87385" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.054264] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 18bb45c8-7cab-44a5-887c-82deb65b8e26 in Status: SUCCESS [ 810.054751] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-18bb45c8-7cab-44a5-887c-82deb65b8e26" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.301717] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d32c421e-531c-4d55-9fca-ba5edd4bc944 [ 810.301717] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.301886] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.301923] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.302149] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.303034] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.303034] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d32c421e-531c-4d55-9fca-ba5edd4bc944 already deleted. [ 810.303034] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d32c421e-531c-4d55-9fca-ba5edd4bc944" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.342063] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0defdd0d-cdbe-4a7c-9871-fd4c40a3847e in Status: SUCCESS [ 810.342294] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0defdd0d-cdbe-4a7c-9871-fd4c40a3847e" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.386553] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6a05f1c7-a743-446b-8d2d-bb7d910c25ee [ 810.386553] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.386553] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.386553] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.386832] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.386832] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.386898] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6a05f1c7-a743-446b-8d2d-bb7d910c25ee already deleted. [ 810.386967] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6a05f1c7-a743-446b-8d2d-bb7d910c25ee" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.486230] env[65306]: INFO networking_nsxv3.common.synchronization [req-c748ba6a-ae91-4743-84c5-be7e11b74080 req-3c341036-d989-4035-854c-904847a52f3d tempest-ImagesTestJSON-762064805 tempest-ImagesTestJSON-762064805-project-member] Enqueued Resource ID: 57bb6fe9-98c4-47f0-9daa-c424a0c9dfee with Priority: HIGHEST for action security_group_members [ 810.486654] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 57bb6fe9-98c4-47f0-9daa-c424a0c9dfee with Priority: HIGHEST for action security_group_members [ 810.487374] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-57bb6fe9-98c4-47f0-9daa-c424a0c9dfee taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.487374] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-57bb6fe9-98c4-47f0-9daa-c424a0c9dfee" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.487374] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-57bb6fe9-98c4-47f0-9daa-c424a0c9dfee" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.487586] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-57bb6fe9-98c4-47f0-9daa-c424a0c9dfee" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.487706] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.487807] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.487876] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.488027] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.488113] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.488226] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('57bb6fe9-98c4-47f0-9daa-c424a0c9dfee',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 810.657172] env[65306]: INFO networking_nsxv3.common.synchronization [req-1fac258f-b672-4392-a054-568a27354d14 req-66eb1a3e-8982-4c6c-b596-f8fc29e0af45 service nova] Enqueued Resource ID: c3ffb1bc-84c3-4121-a677-8d413e70c9cc with Priority: HIGHEST for action security_group_rules [ 810.657172] env[65306]: INFO networking_nsxv3.common.synchronization [req-1fac258f-b672-4392-a054-568a27354d14 req-66eb1a3e-8982-4c6c-b596-f8fc29e0af45 service nova] Enqueued Resource ID: c3ffb1bc-84c3-4121-a677-8d413e70c9cc with Priority: HIGHEST for action security_group_members [ 810.657172] env[65306]: INFO networking_nsxv3.common.synchronization [req-1fac258f-b672-4392-a054-568a27354d14 req-66eb1a3e-8982-4c6c-b596-f8fc29e0af45 service nova] Enqueued Resource ID: 1329df5b-3a32-4c08-9b74-227326e87385 with Priority: HIGHEST for action port [ 810.657172] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c3ffb1bc-84c3-4121-a677-8d413e70c9cc with Priority: HIGHEST for action security_group_rules [ 810.657172] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c3ffb1bc-84c3-4121-a677-8d413e70c9cc with Priority: HIGHEST for action security_group_members [ 810.657172] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1329df5b-3a32-4c08-9b74-227326e87385 with Priority: HIGHEST for action port [ 810.662241] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c3ffb1bc-84c3-4121-a677-8d413e70c9cc taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.662241] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c3ffb1bc-84c3-4121-a677-8d413e70c9cc" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.662241] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c3ffb1bc-84c3-4121-a677-8d413e70c9cc" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.662241] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c3ffb1bc-84c3-4121-a677-8d413e70c9cc" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.662241] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c3ffb1bc-84c3-4121-a677-8d413e70c9cc',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 810.663525] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-c3ffb1bc-84c3-4121-a677-8d413e70c9cc taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.663677] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c3ffb1bc-84c3-4121-a677-8d413e70c9cc" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.663716] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c3ffb1bc-84c3-4121-a677-8d413e70c9cc" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.663916] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c3ffb1bc-84c3-4121-a677-8d413e70c9cc" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.664069] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.664164] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.664229] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.664375] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.664453] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.668415] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c3ffb1bc-84c3-4121-a677-8d413e70c9cc',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 810.669225] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock port-1329df5b-3a32-4c08-9b74-227326e87385 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.669225] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1329df5b-3a32-4c08-9b74-227326e87385" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.669225] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1329df5b-3a32-4c08-9b74-227326e87385" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.669389] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1329df5b-3a32-4c08-9b74-227326e87385" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.669435] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1329df5b-3a32-4c08-9b74-227326e87385',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 810.990589] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.990748] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.991720] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.991720] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.991720] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.991720] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.991720] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.991720] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.991720] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.991720] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.992747] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 57bb6fe9-98c4-47f0-9daa-c424a0c9dfee is going to be updated. [ 811.022308] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.022308] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.022308] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.022647] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.022647] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.035185] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 57bb6fe9-98c4-47f0-9daa-c424a0c9dfee in Status: IN_PROGRESS for 2s [ 811.175950] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1329df5b-3a32-4c08-9b74-227326e87385 with status ACTIVE [ 811.175950] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.176297] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.176297] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.176528] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.176574] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.176775] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.177028] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.177102] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.177487] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.177577] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.177779] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.178291] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.178291] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.178291] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.178291] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.178544] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1329df5b-3a32-4c08-9b74-227326e87385 is going to be updated. [ 811.183498] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-c3ffb1bc-84c3-4121-a677-8d413e70c9cc taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.183498] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c3ffb1bc-84c3-4121-a677-8d413e70c9cc" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.183498] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c3ffb1bc-84c3-4121-a677-8d413e70c9cc',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 811.210979] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.211275] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.211384] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.212257] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.212563] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.212908] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1329df5b-3a32-4c08-9b74-227326e87385" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.687919] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c3ffb1bc-84c3-4121-a677-8d413e70c9cc',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 812.193497] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.193787] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.193787] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.193966] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.194071] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.194175] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c3ffb1bc-84c3-4121-a677-8d413e70c9cc is going to be created. [ 812.222911] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.222911] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.222911] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.222911] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.222911] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.233491] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c3ffb1bc-84c3-4121-a677-8d413e70c9cc in Status: UNINITIALIZED for 2s [ 812.768281] env[65306]: INFO networking_nsxv3.common.synchronization [req-7a597f23-ed22-44c6-a573-255c23d43703 req-d4799974-57a6-45e1-80b9-75151bc10a15 tempest-ServerDiskConfigTestJSON-771154958 tempest-ServerDiskConfigTestJSON-771154958-project-member] Enqueued Resource ID: 9e80329d-1fcd-4c50-8991-a90e2a1fbdbc with Priority: HIGHEST for action security_group_members [ 812.768281] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9e80329d-1fcd-4c50-8991-a90e2a1fbdbc with Priority: HIGHEST for action security_group_members [ 812.768281] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-9e80329d-1fcd-4c50-8991-a90e2a1fbdbc taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.768281] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9e80329d-1fcd-4c50-8991-a90e2a1fbdbc" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.768281] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9e80329d-1fcd-4c50-8991-a90e2a1fbdbc" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.768605] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9e80329d-1fcd-4c50-8991-a90e2a1fbdbc" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.768710] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.768955] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.768955] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.769108] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.769181] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.769273] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9e80329d-1fcd-4c50-8991-a90e2a1fbdbc',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 812.916987] env[65306]: INFO networking_nsxv3.common.synchronization [None req-ca19674b-342b-45dc-9ff6-c40a692f6881 None None] Enqueued Resource ID: 16b8edb7-527d-4d8b-8676-299f42518fc0 with Priority: HIGHEST for action port [ 812.917280] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 16b8edb7-527d-4d8b-8676-299f42518fc0 with Priority: HIGHEST for action port [ 812.918038] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock port-16b8edb7-527d-4d8b-8676-299f42518fc0 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.918165] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-16b8edb7-527d-4d8b-8676-299f42518fc0" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.918237] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-16b8edb7-527d-4d8b-8676-299f42518fc0" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.918698] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-16b8edb7-527d-4d8b-8676-299f42518fc0" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.918838] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('16b8edb7-527d-4d8b-8676-299f42518fc0',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.047237] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 57bb6fe9-98c4-47f0-9daa-c424a0c9dfee in Status: SUCCESS [ 813.047237] env[65306]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 57bb6fe9-98c4-47f0-9daa-c424a0c9dfee deletion is rescheduled due to dependency. [ 813.047237] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-57bb6fe9-98c4-47f0-9daa-c424a0c9dfee" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.271673] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.271963] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.271963] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.272177] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.272270] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.272466] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.272568] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.272633] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.272788] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.272863] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.272955] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9e80329d-1fcd-4c50-8991-a90e2a1fbdbc is going to be updated. [ 813.299767] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.300349] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.300481] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.300678] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.300946] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.311772] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9e80329d-1fcd-4c50-8991-a90e2a1fbdbc in Status: IN_PROGRESS for 2s [ 813.423414] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 16b8edb7-527d-4d8b-8676-299f42518fc0 [ 813.423414] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.423414] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.423414] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.423414] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.423414] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.423414] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:16b8edb7-527d-4d8b-8676-299f42518fc0 already deleted. [ 813.423414] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-16b8edb7-527d-4d8b-8676-299f42518fc0" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.245566] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c3ffb1bc-84c3-4121-a677-8d413e70c9cc in Status: SUCCESS [ 814.245782] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c3ffb1bc-84c3-4121-a677-8d413e70c9cc" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.246133] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c3ffb1bc-84c3-4121-a677-8d413e70c9cc" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.246371] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c3ffb1bc-84c3-4121-a677-8d413e70c9cc" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.246699] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.246833] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.246881] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.247073] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.247138] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.247242] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c3ffb1bc-84c3-4121-a677-8d413e70c9cc" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.247320] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c3ffb1bc-84c3-4121-a677-8d413e70c9cc',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 814.749453] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c3ffb1bc-84c3-4121-a677-8d413e70c9cc',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 815.251934] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c3ffb1bc-84c3-4121-a677-8d413e70c9cc: rpc.has_security_group_logging(os_id): False [ 815.273891] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.273891] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.273891] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.273891] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.273891] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.273891] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.273891] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.273891] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.274323] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.274629] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.274927] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c3ffb1bc-84c3-4121-a677-8d413e70c9cc is going to be created. [ 815.323898] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9e80329d-1fcd-4c50-8991-a90e2a1fbdbc in Status: SUCCESS [ 815.324130] env[65306]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9e80329d-1fcd-4c50-8991-a90e2a1fbdbc deletion is rescheduled due to dependency. [ 815.324130] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9e80329d-1fcd-4c50-8991-a90e2a1fbdbc" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.381597] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.382923] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.382923] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.382923] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.383610] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.398669] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c3ffb1bc-84c3-4121-a677-8d413e70c9cc in Status: IN_PROGRESS for 2s [ 816.586665] env[65306]: INFO networking_nsxv3.common.synchronization [None req-992795d2-3298-473f-88f3-46bded0fa1fe None None] Enqueued Resource ID: fad4d74d-6f9e-4c66-8b9e-e7057e4b3d86 with Priority: HIGHEST for action port [ 816.587253] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fad4d74d-6f9e-4c66-8b9e-e7057e4b3d86 with Priority: HIGHEST for action port [ 816.587563] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock port-fad4d74d-6f9e-4c66-8b9e-e7057e4b3d86 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.587738] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fad4d74d-6f9e-4c66-8b9e-e7057e4b3d86" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.587738] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fad4d74d-6f9e-4c66-8b9e-e7057e4b3d86" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.587999] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fad4d74d-6f9e-4c66-8b9e-e7057e4b3d86" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.588114] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fad4d74d-6f9e-4c66-8b9e-e7057e4b3d86',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.090172] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port fad4d74d-6f9e-4c66-8b9e-e7057e4b3d86 [ 817.090720] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.090720] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.091321] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.091321] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.091321] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.091321] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:fad4d74d-6f9e-4c66-8b9e-e7057e4b3d86 already deleted. [ 817.091321] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fad4d74d-6f9e-4c66-8b9e-e7057e4b3d86" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.413625] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c3ffb1bc-84c3-4121-a677-8d413e70c9cc in Status: SUCCESS [ 817.413863] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c3ffb1bc-84c3-4121-a677-8d413e70c9cc" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.864144] env[65306]: INFO networking_nsxv3.common.synchronization [None req-9215be13-b875-40a6-b37c-020cfc64bbbc None None] Enqueued Resource ID: 6530e8ed-b958-49ef-a9e7-b30383881945 with Priority: HIGHEST for action port [ 818.864144] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6530e8ed-b958-49ef-a9e7-b30383881945 with Priority: HIGHEST for action port [ 818.864144] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock port-6530e8ed-b958-49ef-a9e7-b30383881945 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.864144] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6530e8ed-b958-49ef-a9e7-b30383881945" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.864144] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6530e8ed-b958-49ef-a9e7-b30383881945" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.864846] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6530e8ed-b958-49ef-a9e7-b30383881945" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.865052] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6530e8ed-b958-49ef-a9e7-b30383881945',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 819.097670] env[65306]: INFO networking_nsxv3.common.synchronization [req-9bbaab7f-9a0b-40a4-a0f2-2c80f5172f43 req-9dec301f-0736-4c06-9dc8-b17f448f77af tempest-ServerActionsV293TestJSON-2007661909 tempest-ServerActionsV293TestJSON-2007661909-project-member] Enqueued Resource ID: e21f899c-0473-418d-9b8f-8591e9dc160f with Priority: HIGHEST for action security_group_members [ 819.098362] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e21f899c-0473-418d-9b8f-8591e9dc160f with Priority: HIGHEST for action security_group_members [ 819.098773] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-e21f899c-0473-418d-9b8f-8591e9dc160f taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.098953] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e21f899c-0473-418d-9b8f-8591e9dc160f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.099112] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e21f899c-0473-418d-9b8f-8591e9dc160f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.099770] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e21f899c-0473-418d-9b8f-8591e9dc160f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.099770] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.099875] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.099875] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.100093] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.100183] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.100303] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e21f899c-0473-418d-9b8f-8591e9dc160f',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 819.367189] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6530e8ed-b958-49ef-a9e7-b30383881945 [ 819.367338] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.367557] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.367557] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.367916] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.367916] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.368128] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6530e8ed-b958-49ef-a9e7-b30383881945 already deleted. [ 819.368128] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6530e8ed-b958-49ef-a9e7-b30383881945" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.508321] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock network-713 taken with stack trace [, , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.508837] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "network-713" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.509178] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "network-713" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.509410] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "network-713" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.509810] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.510109] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.510360] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.510734] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.510968] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.511292] env[65306]: DEBUG dogpile.cache.region [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] No value present for key: 'zone-id' {{(pid=65306) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 819.511505] env[65306]: DEBUG dogpile.lock [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] NeedRegenerationException {{(pid=65306) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 819.511687] env[65306]: DEBUG dogpile.lock [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] no value, waiting for create lock {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 819.511847] env[65306]: DEBUG dogpile.lock [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] value creation lock acquired {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 819.512040] env[65306]: DEBUG dogpile.cache.region [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] No value present for key: 'zone-id' {{(pid=65306) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 819.512236] env[65306]: DEBUG dogpile.lock [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Calling creation function for not-yet-present value {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 819.512755] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 819.546747] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 819.546915] env[65306]: DEBUG dogpile.cache.region [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Cache value generated in 0.034 seconds for key(s): 'zone-id' {{(pid=65306) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 819.546984] env[65306]: DEBUG dogpile.lock [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Released creation lock {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 819.547184] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "network-713" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.547524] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock port-a205bfa5-75da-4ce3-b562-f6531c835007 taken with stack trace [, , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.547785] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "port-a205bfa5-75da-4ce3-b562-f6531c835007" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.547919] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "port-a205bfa5-75da-4ce3-b562-f6531c835007" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.548304] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "port-a205bfa5-75da-4ce3-b562-f6531c835007" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.548502] env[65306]: DEBUG networking_nsxv3.api.rpc [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a205bfa5-75da-4ce3-b562-f6531c835007',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 819.603600] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.603775] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.603862] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.605023] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.605023] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.605023] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.605023] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.605023] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.605023] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.605376] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.605376] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e21f899c-0473-418d-9b8f-8591e9dc160f already deleted. [ 819.605376] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e21f899c-0473-418d-9b8f-8591e9dc160f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.791115] env[65306]: INFO networking_nsxv3.common.synchronization [None req-16c4a47c-65e1-48f6-ad83-5f4065000a92 tempest-ServerActionsTestJSON-437813836 tempest-ServerActionsTestJSON-437813836-project-member] Enqueued Resource ID: 3bb1834c-39ac-4ba9-bce1-44f7a4805a24 with Priority: HIGHEST for action security_group_rules [ 819.791866] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3bb1834c-39ac-4ba9-bce1-44f7a4805a24 with Priority: HIGHEST for action security_group_rules [ 819.792618] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3bb1834c-39ac-4ba9-bce1-44f7a4805a24 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.792802] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3bb1834c-39ac-4ba9-bce1-44f7a4805a24" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.792888] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3bb1834c-39ac-4ba9-bce1-44f7a4805a24" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.793180] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3bb1834c-39ac-4ba9-bce1-44f7a4805a24" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.793317] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3bb1834c-39ac-4ba9-bce1-44f7a4805a24',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 819.986968] env[65306]: INFO networking_nsxv3.common.synchronization [None req-6ff9cbb2-2abc-4514-a1c5-d1bec8d6f87a tempest-ServerActionsTestJSON-437813836 tempest-ServerActionsTestJSON-437813836-project-member] Enqueued Resource ID: 3bb1834c-39ac-4ba9-bce1-44f7a4805a24 with Priority: HIGHEST for action security_group_rules [ 819.992245] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3bb1834c-39ac-4ba9-bce1-44f7a4805a24 with Priority: HIGHEST for action security_group_rules [ 819.992245] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3bb1834c-39ac-4ba9-bce1-44f7a4805a24 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.992245] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3bb1834c-39ac-4ba9-bce1-44f7a4805a24" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.050759] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.053470] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.053470] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.053470] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.053470] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.053470] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Segment Port a205bfa5-75da-4ce3-b562-f6531c835007 not found, creating... [ 820.053470] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.053470] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.053813] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.053813] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.053937] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.054850] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.054850] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.054850] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.055076] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.055239] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.055401] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Resource: SegmentPort with ID: a205bfa5-75da-4ce3-b562-f6531c835007 is going to be created. [ 820.085904] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.086135] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.086260] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.086535] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.086790] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.087050] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "port-a205bfa5-75da-4ce3-b562-f6531c835007" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.316118] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.316327] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.316436] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.316697] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.316797] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.316918] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3bb1834c-39ac-4ba9-bce1-44f7a4805a24 already deleted. [ 820.317063] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3bb1834c-39ac-4ba9-bce1-44f7a4805a24" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.317252] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3bb1834c-39ac-4ba9-bce1-44f7a4805a24" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.317465] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3bb1834c-39ac-4ba9-bce1-44f7a4805a24" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.317584] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3bb1834c-39ac-4ba9-bce1-44f7a4805a24',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.781212] env[65306]: INFO networking_nsxv3.common.synchronization [req-9bbaab7f-9a0b-40a4-a0f2-2c80f5172f43 req-6c67981d-2345-4b6c-b4f6-db2859a88b96 service nova] Enqueued Resource ID: e21f899c-0473-418d-9b8f-8591e9dc160f with Priority: HIGHEST for action security_group_rules [ 820.781212] env[65306]: INFO networking_nsxv3.common.synchronization [req-9bbaab7f-9a0b-40a4-a0f2-2c80f5172f43 req-6c67981d-2345-4b6c-b4f6-db2859a88b96 service nova] Enqueued Resource ID: e21f899c-0473-418d-9b8f-8591e9dc160f with Priority: HIGHEST for action security_group_members [ 820.781212] env[65306]: INFO networking_nsxv3.common.synchronization [req-9bbaab7f-9a0b-40a4-a0f2-2c80f5172f43 req-6c67981d-2345-4b6c-b4f6-db2859a88b96 service nova] Enqueued Resource ID: a205bfa5-75da-4ce3-b562-f6531c835007 with Priority: HIGHEST for action port [ 820.781589] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e21f899c-0473-418d-9b8f-8591e9dc160f with Priority: HIGHEST for action security_group_rules [ 820.781632] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e21f899c-0473-418d-9b8f-8591e9dc160f with Priority: HIGHEST for action security_group_members [ 820.781719] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a205bfa5-75da-4ce3-b562-f6531c835007 with Priority: HIGHEST for action port [ 820.781994] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e21f899c-0473-418d-9b8f-8591e9dc160f taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.782261] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e21f899c-0473-418d-9b8f-8591e9dc160f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.782336] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e21f899c-0473-418d-9b8f-8591e9dc160f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.782556] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e21f899c-0473-418d-9b8f-8591e9dc160f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.782662] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e21f899c-0473-418d-9b8f-8591e9dc160f',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.785033] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-e21f899c-0473-418d-9b8f-8591e9dc160f taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.785033] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e21f899c-0473-418d-9b8f-8591e9dc160f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.785152] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e21f899c-0473-418d-9b8f-8591e9dc160f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.785622] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e21f899c-0473-418d-9b8f-8591e9dc160f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.785622] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.785992] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.785992] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.785992] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.786258] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.786258] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e21f899c-0473-418d-9b8f-8591e9dc160f',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.787262] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock port-a205bfa5-75da-4ce3-b562-f6531c835007 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.788214] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a205bfa5-75da-4ce3-b562-f6531c835007" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.788568] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a205bfa5-75da-4ce3-b562-f6531c835007" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.789278] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a205bfa5-75da-4ce3-b562-f6531c835007" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.789278] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a205bfa5-75da-4ce3-b562-f6531c835007',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.839177] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.839344] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.839384] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.839600] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.839689] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.839783] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3bb1834c-39ac-4ba9-bce1-44f7a4805a24 already deleted. [ 820.839864] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3bb1834c-39ac-4ba9-bce1-44f7a4805a24" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.285514] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-e21f899c-0473-418d-9b8f-8591e9dc160f taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.285823] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e21f899c-0473-418d-9b8f-8591e9dc160f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.291202] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e21f899c-0473-418d-9b8f-8591e9dc160f',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.292494] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a205bfa5-75da-4ce3-b562-f6531c835007 with status ACTIVE [ 821.292870] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.293636] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.293734] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.293953] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.294053] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.294252] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.294358] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.294431] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.294578] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.294653] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.294836] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.294930] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.294986] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.295151] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.295225] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.295311] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a205bfa5-75da-4ce3-b562-f6531c835007 is going to be updated. [ 821.319370] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.319625] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.319625] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.319856] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.319967] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.320182] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a205bfa5-75da-4ce3-b562-f6531c835007" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.711729] env[65306]: INFO networking_nsxv3.common.synchronization [req-4a0ebfb3-dfaa-42f2-90e0-7572a5901ef7 req-c1251bb4-6b85-4115-825d-943ba3dedd89 tempest-ServerAddressesNegativeTestJSON-17326784 tempest-ServerAddressesNegativeTestJSON-17326784-project-member] Enqueued Resource ID: c9bd98cc-e392-44de-a51c-e4fc7d37da1f with Priority: HIGHEST for action security_group_members [ 821.712292] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c9bd98cc-e392-44de-a51c-e4fc7d37da1f with Priority: HIGHEST for action security_group_members [ 821.712591] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-c9bd98cc-e392-44de-a51c-e4fc7d37da1f taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.712725] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c9bd98cc-e392-44de-a51c-e4fc7d37da1f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.712800] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c9bd98cc-e392-44de-a51c-e4fc7d37da1f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.714145] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c9bd98cc-e392-44de-a51c-e4fc7d37da1f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.714237] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.714409] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.714495] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.715351] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.715548] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.715755] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c9bd98cc-e392-44de-a51c-e4fc7d37da1f',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.798024] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e21f899c-0473-418d-9b8f-8591e9dc160f',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 822.110618] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock network-319 taken with stack trace [, , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.110618] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "network-319" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.110618] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "network-319" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.110618] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "network-319" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.110618] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.110618] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.110618] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.111084] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.111084] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.111160] env[65306]: DEBUG dogpile.cache.region [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] No value present for key: 'zone-id' {{(pid=65306) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 822.112032] env[65306]: DEBUG dogpile.lock [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] NeedRegenerationException {{(pid=65306) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 822.112032] env[65306]: DEBUG dogpile.lock [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] no value, waiting for create lock {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 822.112032] env[65306]: DEBUG dogpile.lock [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] value creation lock acquired {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 822.112032] env[65306]: DEBUG dogpile.cache.region [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] No value present for key: 'zone-id' {{(pid=65306) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 822.112032] env[65306]: DEBUG dogpile.lock [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Calling creation function for not-yet-present value {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 822.112032] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 822.131143] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 822.131331] env[65306]: DEBUG dogpile.cache.region [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65306) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 822.131494] env[65306]: DEBUG dogpile.lock [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Released creation lock {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 822.131680] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "network-319" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.131989] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock port-b90b9c2e-d281-49a9-840c-5349d842abbe taken with stack trace [, , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.132170] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "port-b90b9c2e-d281-49a9-840c-5349d842abbe" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.132290] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "port-b90b9c2e-d281-49a9-840c-5349d842abbe" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.132604] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "port-b90b9c2e-d281-49a9-840c-5349d842abbe" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.132750] env[65306]: DEBUG networking_nsxv3.api.rpc [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b90b9c2e-d281-49a9-840c-5349d842abbe',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 822.218901] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.219117] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.219194] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.219357] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.219438] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.219701] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.219829] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.219894] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.220058] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.220137] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.220230] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c9bd98cc-e392-44de-a51c-e4fc7d37da1f already deleted. [ 822.220328] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c9bd98cc-e392-44de-a51c-e4fc7d37da1f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.304185] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.304547] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.304547] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.304672] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.304728] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.304903] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e21f899c-0473-418d-9b8f-8591e9dc160f is going to be created. [ 822.332955] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.333353] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.333353] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.334387] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.334387] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.345758] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e21f899c-0473-418d-9b8f-8591e9dc160f in Status: UNINITIALIZED for 2s [ 822.635638] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.635895] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.636028] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.636429] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.636597] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.636597] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Segment Port b90b9c2e-d281-49a9-840c-5349d842abbe not found, creating... [ 822.636850] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.637093] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.637308] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.637541] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.637665] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.637959] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.638126] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.638239] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.638471] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.638605] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.638743] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Resource: SegmentPort with ID: b90b9c2e-d281-49a9-840c-5349d842abbe is going to be created. [ 822.659125] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.659557] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.659701] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.660123] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.660271] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.660565] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "port-b90b9c2e-d281-49a9-840c-5349d842abbe" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.438646] env[65306]: INFO networking_nsxv3.common.synchronization [req-4a0ebfb3-dfaa-42f2-90e0-7572a5901ef7 req-f2e3f03b-f3f1-46a1-9f14-e1a872e418fa service nova] Enqueued Resource ID: c9bd98cc-e392-44de-a51c-e4fc7d37da1f with Priority: HIGHEST for action security_group_rules [ 823.438646] env[65306]: INFO networking_nsxv3.common.synchronization [req-4a0ebfb3-dfaa-42f2-90e0-7572a5901ef7 req-f2e3f03b-f3f1-46a1-9f14-e1a872e418fa service nova] Enqueued Resource ID: c9bd98cc-e392-44de-a51c-e4fc7d37da1f with Priority: HIGHEST for action security_group_members [ 823.438646] env[65306]: INFO networking_nsxv3.common.synchronization [req-4a0ebfb3-dfaa-42f2-90e0-7572a5901ef7 req-f2e3f03b-f3f1-46a1-9f14-e1a872e418fa service nova] Enqueued Resource ID: b90b9c2e-d281-49a9-840c-5349d842abbe with Priority: HIGHEST for action port [ 823.439135] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c9bd98cc-e392-44de-a51c-e4fc7d37da1f with Priority: HIGHEST for action security_group_rules [ 823.439135] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c9bd98cc-e392-44de-a51c-e4fc7d37da1f with Priority: HIGHEST for action security_group_members [ 823.439205] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b90b9c2e-d281-49a9-840c-5349d842abbe with Priority: HIGHEST for action port [ 823.439476] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c9bd98cc-e392-44de-a51c-e4fc7d37da1f taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.439698] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c9bd98cc-e392-44de-a51c-e4fc7d37da1f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.439748] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c9bd98cc-e392-44de-a51c-e4fc7d37da1f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.439984] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c9bd98cc-e392-44de-a51c-e4fc7d37da1f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.440082] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c9bd98cc-e392-44de-a51c-e4fc7d37da1f',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 823.441074] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-c9bd98cc-e392-44de-a51c-e4fc7d37da1f taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.441185] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c9bd98cc-e392-44de-a51c-e4fc7d37da1f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.441249] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c9bd98cc-e392-44de-a51c-e4fc7d37da1f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.441429] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c9bd98cc-e392-44de-a51c-e4fc7d37da1f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.441598] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.441700] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.441781] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.442058] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.442058] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.442148] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c9bd98cc-e392-44de-a51c-e4fc7d37da1f',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 823.442993] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock port-b90b9c2e-d281-49a9-840c-5349d842abbe taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.442993] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b90b9c2e-d281-49a9-840c-5349d842abbe" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.443175] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b90b9c2e-d281-49a9-840c-5349d842abbe" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.443223] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b90b9c2e-d281-49a9-840c-5349d842abbe" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.443298] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b90b9c2e-d281-49a9-840c-5349d842abbe',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 823.945110] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c9bd98cc-e392-44de-a51c-e4fc7d37da1f',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 823.946304] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-c9bd98cc-e392-44de-a51c-e4fc7d37da1f taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.946454] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c9bd98cc-e392-44de-a51c-e4fc7d37da1f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.946679] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b90b9c2e-d281-49a9-840c-5349d842abbe with status ACTIVE [ 823.946968] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.947089] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.947157] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.947765] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.947765] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.947765] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.948932] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.948932] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.948932] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.948932] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.948932] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.949287] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.949385] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.949710] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.949710] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.949874] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b90b9c2e-d281-49a9-840c-5349d842abbe is going to be updated. [ 823.976412] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.976412] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.976412] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.976638] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.976638] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.976762] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b90b9c2e-d281-49a9-840c-5349d842abbe" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.358135] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e21f899c-0473-418d-9b8f-8591e9dc160f in Status: SUCCESS [ 824.358359] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e21f899c-0473-418d-9b8f-8591e9dc160f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.358528] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e21f899c-0473-418d-9b8f-8591e9dc160f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.358742] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e21f899c-0473-418d-9b8f-8591e9dc160f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.360023] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.360023] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.360023] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.360023] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.360023] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.360023] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e21f899c-0473-418d-9b8f-8591e9dc160f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.360023] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e21f899c-0473-418d-9b8f-8591e9dc160f',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 824.452168] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c9bd98cc-e392-44de-a51c-e4fc7d37da1f',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 824.862801] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e21f899c-0473-418d-9b8f-8591e9dc160f',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 824.955416] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.955655] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.955655] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.956508] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.956508] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.956508] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c9bd98cc-e392-44de-a51c-e4fc7d37da1f is going to be created. [ 824.997203] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.997360] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.997435] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.997680] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.997861] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.010094] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c9bd98cc-e392-44de-a51c-e4fc7d37da1f in Status: UNINITIALIZED for 2s [ 825.366652] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e21f899c-0473-418d-9b8f-8591e9dc160f: rpc.has_security_group_logging(os_id): False [ 825.389803] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.389803] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.389803] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.390128] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.390128] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.390345] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.390503] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.390579] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.390741] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.390830] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.390907] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e21f899c-0473-418d-9b8f-8591e9dc160f is going to be created. [ 825.480063] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.480063] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.480063] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.480625] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.480625] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.497798] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e21f899c-0473-418d-9b8f-8591e9dc160f in Status: IN_PROGRESS for 2s [ 827.021361] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c9bd98cc-e392-44de-a51c-e4fc7d37da1f in Status: SUCCESS [ 827.021773] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c9bd98cc-e392-44de-a51c-e4fc7d37da1f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.021890] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c9bd98cc-e392-44de-a51c-e4fc7d37da1f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.022174] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c9bd98cc-e392-44de-a51c-e4fc7d37da1f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.022412] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.022584] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.022662] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.022948] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.023072] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.023189] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c9bd98cc-e392-44de-a51c-e4fc7d37da1f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.023311] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c9bd98cc-e392-44de-a51c-e4fc7d37da1f',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.513182] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e21f899c-0473-418d-9b8f-8591e9dc160f in Status: SUCCESS [ 827.513400] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e21f899c-0473-418d-9b8f-8591e9dc160f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.526085] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-c9bd98cc-e392-44de-a51c-e4fc7d37da1f taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.526270] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c9bd98cc-e392-44de-a51c-e4fc7d37da1f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.526320] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c9bd98cc-e392-44de-a51c-e4fc7d37da1f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.526533] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c9bd98cc-e392-44de-a51c-e4fc7d37da1f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.526702] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.526800] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.526864] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.527016] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.527123] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.527235] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c9bd98cc-e392-44de-a51c-e4fc7d37da1f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.527449] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-c9bd98cc-e392-44de-a51c-e4fc7d37da1f taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.527603] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c9bd98cc-e392-44de-a51c-e4fc7d37da1f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.527691] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c9bd98cc-e392-44de-a51c-e4fc7d37da1f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.527902] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c9bd98cc-e392-44de-a51c-e4fc7d37da1f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.528150] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.528316] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.528430] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.528629] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.528772] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.528914] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c9bd98cc-e392-44de-a51c-e4fc7d37da1f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.529112] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c9bd98cc-e392-44de-a51c-e4fc7d37da1f',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 828.031591] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c9bd98cc-e392-44de-a51c-e4fc7d37da1f: rpc.has_security_group_logging(os_id): False [ 828.052030] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.052179] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.052251] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.052425] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.052558] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.052746] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.052862] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.052960] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.053204] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.053259] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.053456] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.053600] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.053653] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.053878] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.053960] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.054812] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.054931] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.055021] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.055211] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.055306] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.057399] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c9bd98cc-e392-44de-a51c-e4fc7d37da1f is going to be created. [ 828.117453] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.117620] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.117682] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.117890] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.118151] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.131627] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c9bd98cc-e392-44de-a51c-e4fc7d37da1f in Status: IN_PROGRESS for 2s [ 828.440841] env[65306]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 828.440841] env[65306]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 830.147984] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c9bd98cc-e392-44de-a51c-e4fc7d37da1f in Status: SUCCESS [ 830.147984] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c9bd98cc-e392-44de-a51c-e4fc7d37da1f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.441543] env[65306]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 833.442087] env[65306]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 833.709979] env[65306]: INFO networking_nsxv3.common.synchronization [req-c6b51e55-a443-498d-9968-2e4f9a9509af req-aadb53a7-87d2-4f8b-8f52-05696ec0d09a tempest-ServersTestJSON-1200400240 tempest-ServersTestJSON-1200400240-project-member] Enqueued Resource ID: c90bbe47-7f68-400a-a228-2030ba9cad31 with Priority: HIGHEST for action security_group_members [ 833.710792] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c90bbe47-7f68-400a-a228-2030ba9cad31 with Priority: HIGHEST for action security_group_members [ 833.711228] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-c90bbe47-7f68-400a-a228-2030ba9cad31 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.711505] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c90bbe47-7f68-400a-a228-2030ba9cad31" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.711634] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c90bbe47-7f68-400a-a228-2030ba9cad31" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.711967] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c90bbe47-7f68-400a-a228-2030ba9cad31" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.712181] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.712332] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.712435] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.712648] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.712785] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.712921] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c90bbe47-7f68-400a-a228-2030ba9cad31',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 834.043913] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock network-901 taken with stack trace [, , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.044198] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "network-901" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.044411] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "network-901" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.044740] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "network-901" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.045017] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.045162] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.045286] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.045486] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.045630] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.045839] env[65306]: DEBUG dogpile.cache.region [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] No value present for key: 'zone-id' {{(pid=65306) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 834.045948] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] NeedRegenerationException {{(pid=65306) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 834.046067] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] no value, waiting for create lock {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 834.046174] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] value creation lock acquired {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 834.046279] env[65306]: DEBUG dogpile.cache.region [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] No value present for key: 'zone-id' {{(pid=65306) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 834.046380] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Calling creation function for not-yet-present value {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 834.046510] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 834.070693] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 834.070941] env[65306]: DEBUG dogpile.cache.region [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65306) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 834.071033] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Released creation lock {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 834.071201] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "network-901" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.071501] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock port-5dcd4b2d-c4f4-4e06-bf6c-330c30775aec taken with stack trace [, , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.071700] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "port-5dcd4b2d-c4f4-4e06-bf6c-330c30775aec" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.071810] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "port-5dcd4b2d-c4f4-4e06-bf6c-330c30775aec" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.072140] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "port-5dcd4b2d-c4f4-4e06-bf6c-330c30775aec" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.072267] env[65306]: DEBUG networking_nsxv3.api.rpc [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5dcd4b2d-c4f4-4e06-bf6c-330c30775aec',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 834.215794] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.215971] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.216052] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.216266] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.216356] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.216553] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.216650] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.216713] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.216861] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.216936] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.217033] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c90bbe47-7f68-400a-a228-2030ba9cad31 already deleted. [ 834.217113] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c90bbe47-7f68-400a-a228-2030ba9cad31" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.544195] env[65306]: INFO networking_nsxv3.common.synchronization [req-a8bebd5a-af5b-4d3c-a2c6-e045f6315155 req-874b67d7-a45e-4503-b2d6-5823bd4f4770 tempest-ServerAddressesNegativeTestJSON-17326784 tempest-ServerAddressesNegativeTestJSON-17326784-project-member] Enqueued Resource ID: c9bd98cc-e392-44de-a51c-e4fc7d37da1f with Priority: HIGHEST for action security_group_members [ 834.544741] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c9bd98cc-e392-44de-a51c-e4fc7d37da1f with Priority: HIGHEST for action security_group_members [ 834.545064] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-c9bd98cc-e392-44de-a51c-e4fc7d37da1f taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.545192] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c9bd98cc-e392-44de-a51c-e4fc7d37da1f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.545259] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c9bd98cc-e392-44de-a51c-e4fc7d37da1f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.545511] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c9bd98cc-e392-44de-a51c-e4fc7d37da1f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.545746] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.545937] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.546056] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.546244] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.546337] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.546440] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c9bd98cc-e392-44de-a51c-e4fc7d37da1f',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 834.577849] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.577849] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.577849] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.578115] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.578233] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.578472] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Segment Port 5dcd4b2d-c4f4-4e06-bf6c-330c30775aec not found, creating... [ 834.578769] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.578929] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.579061] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.579283] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.579421] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.579706] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.579849] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.579973] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.580184] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.580316] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.580511] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Resource: SegmentPort with ID: 5dcd4b2d-c4f4-4e06-bf6c-330c30775aec is going to be created. [ 834.604179] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.604457] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.604457] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.604749] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.605031] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.605277] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "port-5dcd4b2d-c4f4-4e06-bf6c-330c30775aec" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.048822] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.049039] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.049088] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.049340] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.049458] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.049675] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.049804] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.049863] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.050037] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.050145] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.050197] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c9bd98cc-e392-44de-a51c-e4fc7d37da1f is going to be updated. [ 835.080977] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.081265] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.081265] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.081421] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.081570] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.092194] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c9bd98cc-e392-44de-a51c-e4fc7d37da1f in Status: IN_PROGRESS for 2s [ 835.351884] env[65306]: INFO networking_nsxv3.common.synchronization [req-c6b51e55-a443-498d-9968-2e4f9a9509af req-87786fbf-2464-42b3-bb31-b209c68dc786 service nova] Enqueued Resource ID: c90bbe47-7f68-400a-a228-2030ba9cad31 with Priority: HIGHEST for action security_group_rules [ 835.352089] env[65306]: INFO networking_nsxv3.common.synchronization [req-c6b51e55-a443-498d-9968-2e4f9a9509af req-87786fbf-2464-42b3-bb31-b209c68dc786 service nova] Enqueued Resource ID: c90bbe47-7f68-400a-a228-2030ba9cad31 with Priority: HIGHEST for action security_group_members [ 835.353027] env[65306]: INFO networking_nsxv3.common.synchronization [req-c6b51e55-a443-498d-9968-2e4f9a9509af req-87786fbf-2464-42b3-bb31-b209c68dc786 service nova] Enqueued Resource ID: 5dcd4b2d-c4f4-4e06-bf6c-330c30775aec with Priority: HIGHEST for action port [ 835.353027] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c90bbe47-7f68-400a-a228-2030ba9cad31 with Priority: HIGHEST for action security_group_rules [ 835.353027] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c90bbe47-7f68-400a-a228-2030ba9cad31 with Priority: HIGHEST for action security_group_members [ 835.353027] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5dcd4b2d-c4f4-4e06-bf6c-330c30775aec with Priority: HIGHEST for action port [ 835.353253] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c90bbe47-7f68-400a-a228-2030ba9cad31 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.353552] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c90bbe47-7f68-400a-a228-2030ba9cad31" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.353552] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c90bbe47-7f68-400a-a228-2030ba9cad31" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.353626] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c90bbe47-7f68-400a-a228-2030ba9cad31" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.353701] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c90bbe47-7f68-400a-a228-2030ba9cad31',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 835.354556] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-c90bbe47-7f68-400a-a228-2030ba9cad31 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.354644] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c90bbe47-7f68-400a-a228-2030ba9cad31" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.354701] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c90bbe47-7f68-400a-a228-2030ba9cad31" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.354864] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c90bbe47-7f68-400a-a228-2030ba9cad31" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.355015] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.355142] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.355209] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.355312] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.355579] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.355579] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c90bbe47-7f68-400a-a228-2030ba9cad31',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 835.356310] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock port-5dcd4b2d-c4f4-4e06-bf6c-330c30775aec taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.357946] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5dcd4b2d-c4f4-4e06-bf6c-330c30775aec" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.357946] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5dcd4b2d-c4f4-4e06-bf6c-330c30775aec" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.357946] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5dcd4b2d-c4f4-4e06-bf6c-330c30775aec" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.357946] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5dcd4b2d-c4f4-4e06-bf6c-330c30775aec',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 835.859273] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c90bbe47-7f68-400a-a228-2030ba9cad31',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 835.860586] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-c90bbe47-7f68-400a-a228-2030ba9cad31 taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.860728] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c90bbe47-7f68-400a-a228-2030ba9cad31" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.861124] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5dcd4b2d-c4f4-4e06-bf6c-330c30775aec with status ACTIVE [ 835.861278] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.861487] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.861578] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.861888] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.862042] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.862316] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.862464] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.862558] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.862871] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.863055] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.863280] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.863410] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.863790] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.863790] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.863790] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.863967] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5dcd4b2d-c4f4-4e06-bf6c-330c30775aec is going to be updated. [ 835.889056] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.889056] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.889056] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.889056] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.889394] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.889394] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5dcd4b2d-c4f4-4e06-bf6c-330c30775aec" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.365874] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c90bbe47-7f68-400a-a228-2030ba9cad31',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 836.386303] env[65306]: INFO networking_nsxv3.common.synchronization [req-aedfa7a7-e0dd-4614-85c1-67599c8760e7 req-6394e96c-b387-4771-8a18-ff7b35e9f52d tempest-SecurityGroupsTestJSON-960025904 tempest-SecurityGroupsTestJSON-960025904-project-member] Enqueued Resource ID: 4e234e08-a192-4c7a-badf-3e57629854d7 with Priority: HIGHEST for action security_group_members [ 836.387998] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4e234e08-a192-4c7a-badf-3e57629854d7 with Priority: HIGHEST for action security_group_members [ 836.387998] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-4e234e08-a192-4c7a-badf-3e57629854d7 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.389674] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4e234e08-a192-4c7a-badf-3e57629854d7" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.389674] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4e234e08-a192-4c7a-badf-3e57629854d7" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.389674] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4e234e08-a192-4c7a-badf-3e57629854d7" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.389674] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.389674] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.389674] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.390266] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.390754] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.390890] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4e234e08-a192-4c7a-badf-3e57629854d7',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 836.873241] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.873241] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.873241] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.873241] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.873241] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.873241] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c90bbe47-7f68-400a-a228-2030ba9cad31 is going to be created. [ 836.893630] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4e234e08-a192-4c7a-badf-3e57629854d7',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 836.897539] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.897539] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.897539] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.897539] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.897539] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.909758] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c90bbe47-7f68-400a-a228-2030ba9cad31 in Status: UNINITIALIZED for 2s [ 837.039925] env[65306]: INFO networking_nsxv3.common.synchronization [req-73cb65dc-35b1-4cbf-a19c-0d49f297234b req-f65a891e-4d43-44c4-8f4d-1a52009670f7 tempest-FloatingIPsAssociationTestJSON-1677333687 tempest-FloatingIPsAssociationTestJSON-1677333687-project-member] Enqueued Resource ID: 3eee5457-701b-405e-bdf2-f055e0150d49 with Priority: HIGHEST for action security_group_members [ 837.041887] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3eee5457-701b-405e-bdf2-f055e0150d49 with Priority: HIGHEST for action security_group_members [ 837.041887] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-3eee5457-701b-405e-bdf2-f055e0150d49 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.041887] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3eee5457-701b-405e-bdf2-f055e0150d49" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.041887] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3eee5457-701b-405e-bdf2-f055e0150d49" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.041887] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3eee5457-701b-405e-bdf2-f055e0150d49" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.041887] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.041887] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.041887] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.042365] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.042365] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.042365] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3eee5457-701b-405e-bdf2-f055e0150d49',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 837.106769] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c9bd98cc-e392-44de-a51c-e4fc7d37da1f in Status: SUCCESS [ 837.108195] env[65306]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c9bd98cc-e392-44de-a51c-e4fc7d37da1f deletion is rescheduled due to dependency. [ 837.108195] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c9bd98cc-e392-44de-a51c-e4fc7d37da1f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.189483] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock network-504 taken with stack trace [, , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.189483] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "network-504" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.189483] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "network-504" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.189483] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "network-504" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.189977] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.190388] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.190696] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.191103] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.191423] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.192442] env[65306]: DEBUG dogpile.cache.region [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] No value present for key: 'zone-id' {{(pid=65306) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 837.192442] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] NeedRegenerationException {{(pid=65306) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 837.192442] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] no value, waiting for create lock {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 837.192442] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] value creation lock acquired {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 837.192442] env[65306]: DEBUG dogpile.cache.region [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] No value present for key: 'zone-id' {{(pid=65306) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 837.192649] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Calling creation function for not-yet-present value {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 837.192649] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 837.216746] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 837.216746] env[65306]: DEBUG dogpile.cache.region [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65306) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 837.216824] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Released creation lock {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 837.217065] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "network-504" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.217375] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock port-e02bffcf-337d-4619-9629-a50e2941c30d taken with stack trace [, , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.217567] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "port-e02bffcf-337d-4619-9629-a50e2941c30d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.217707] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "port-e02bffcf-337d-4619-9629-a50e2941c30d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.218042] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "port-e02bffcf-337d-4619-9629-a50e2941c30d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.218191] env[65306]: DEBUG networking_nsxv3.api.rpc [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e02bffcf-337d-4619-9629-a50e2941c30d',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 837.395597] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4e234e08-a192-4c7a-badf-3e57629854d7',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 837.546354] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.546500] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.546564] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.546759] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.546853] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.547062] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.547218] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.547356] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.547394] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.547469] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.547539] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3eee5457-701b-405e-bdf2-f055e0150d49 is going to be updated. [ 837.576211] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.576362] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.576435] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.576641] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.576791] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.585907] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3eee5457-701b-405e-bdf2-f055e0150d49 in Status: IN_PROGRESS for 2s [ 837.720898] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.721149] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.721284] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.721707] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.721881] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.722052] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Segment Port e02bffcf-337d-4619-9629-a50e2941c30d not found, creating... [ 837.722314] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.722494] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.722632] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.722881] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.723047] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.723352] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.723506] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.723626] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.723850] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.723980] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.724135] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Resource: SegmentPort with ID: e02bffcf-337d-4619-9629-a50e2941c30d is going to be created. [ 837.748695] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.748937] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.749136] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.749519] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.749850] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.750549] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "port-e02bffcf-337d-4619-9629-a50e2941c30d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.897458] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.897803] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.897803] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.897942] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.898125] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.898194] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4e234e08-a192-4c7a-badf-3e57629854d7 is going to be updated. [ 837.958793] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.958793] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.958793] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.959342] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.959342] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.970384] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4e234e08-a192-4c7a-badf-3e57629854d7 in Status: IN_PROGRESS for 2s [ 838.489555] env[65306]: INFO networking_nsxv3.common.synchronization [req-aedfa7a7-e0dd-4614-85c1-67599c8760e7 req-50bd6988-1a3e-47fc-939b-4d824765446f service nova] Enqueued Resource ID: 4e234e08-a192-4c7a-badf-3e57629854d7 with Priority: HIGHEST for action security_group_rules [ 838.489680] env[65306]: INFO networking_nsxv3.common.synchronization [req-aedfa7a7-e0dd-4614-85c1-67599c8760e7 req-50bd6988-1a3e-47fc-939b-4d824765446f service nova] Enqueued Resource ID: 4e234e08-a192-4c7a-badf-3e57629854d7 with Priority: HIGHEST for action security_group_members [ 838.489785] env[65306]: INFO networking_nsxv3.common.synchronization [req-aedfa7a7-e0dd-4614-85c1-67599c8760e7 req-50bd6988-1a3e-47fc-939b-4d824765446f service nova] Enqueued Resource ID: e02bffcf-337d-4619-9629-a50e2941c30d with Priority: HIGHEST for action port [ 838.490331] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4e234e08-a192-4c7a-badf-3e57629854d7 with Priority: HIGHEST for action security_group_rules [ 838.490530] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4e234e08-a192-4c7a-badf-3e57629854d7 with Priority: HIGHEST for action security_group_members [ 838.490772] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e02bffcf-337d-4619-9629-a50e2941c30d with Priority: HIGHEST for action port [ 838.492164] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4e234e08-a192-4c7a-badf-3e57629854d7 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.492289] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4e234e08-a192-4c7a-badf-3e57629854d7" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.492289] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4e234e08-a192-4c7a-badf-3e57629854d7" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.492470] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4e234e08-a192-4c7a-badf-3e57629854d7" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.492553] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4e234e08-a192-4c7a-badf-3e57629854d7',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 838.493865] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-4e234e08-a192-4c7a-badf-3e57629854d7 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.493955] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4e234e08-a192-4c7a-badf-3e57629854d7" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.494877] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock port-e02bffcf-337d-4619-9629-a50e2941c30d taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.494877] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e02bffcf-337d-4619-9629-a50e2941c30d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.494877] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e02bffcf-337d-4619-9629-a50e2941c30d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.494877] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e02bffcf-337d-4619-9629-a50e2941c30d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.494877] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e02bffcf-337d-4619-9629-a50e2941c30d',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 838.921402] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c90bbe47-7f68-400a-a228-2030ba9cad31 in Status: SUCCESS [ 838.921402] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c90bbe47-7f68-400a-a228-2030ba9cad31" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.921988] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c90bbe47-7f68-400a-a228-2030ba9cad31" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.921988] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c90bbe47-7f68-400a-a228-2030ba9cad31" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.922106] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.922182] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.922257] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.922426] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.922564] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.922605] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c90bbe47-7f68-400a-a228-2030ba9cad31" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.922676] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c90bbe47-7f68-400a-a228-2030ba9cad31',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 838.996673] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e02bffcf-337d-4619-9629-a50e2941c30d with status ACTIVE [ 838.996787] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.996883] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.996928] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.997173] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.997274] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.997502] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.998083] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.998083] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.998083] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.998083] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.998246] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.998299] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.998347] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.998497] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.998570] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.998655] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e02bffcf-337d-4619-9629-a50e2941c30d is going to be updated. [ 838.999944] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-4e234e08-a192-4c7a-badf-3e57629854d7 taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.000063] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4e234e08-a192-4c7a-badf-3e57629854d7" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.021975] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.022145] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.022219] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.022436] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.022580] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.022774] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e02bffcf-337d-4619-9629-a50e2941c30d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.424957] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c90bbe47-7f68-400a-a228-2030ba9cad31',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 839.597018] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3eee5457-701b-405e-bdf2-f055e0150d49 in Status: SUCCESS [ 839.597334] env[65306]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3eee5457-701b-405e-bdf2-f055e0150d49 deletion is rescheduled due to dependency. [ 839.597472] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3eee5457-701b-405e-bdf2-f055e0150d49" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.930412] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c90bbe47-7f68-400a-a228-2030ba9cad31: rpc.has_security_group_logging(os_id): False [ 839.956999] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.956999] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.956999] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.956999] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.956999] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.956999] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.956999] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.956999] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.956999] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.963524] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.963524] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c90bbe47-7f68-400a-a228-2030ba9cad31 is going to be created. [ 839.979868] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4e234e08-a192-4c7a-badf-3e57629854d7 in Status: SUCCESS [ 839.980255] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4e234e08-a192-4c7a-badf-3e57629854d7" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.980632] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4e234e08-a192-4c7a-badf-3e57629854d7" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.980959] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4e234e08-a192-4c7a-badf-3e57629854d7" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.981303] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.981516] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.981619] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.982131] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.982131] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.982265] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4e234e08-a192-4c7a-badf-3e57629854d7',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 840.036843] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.037064] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.037162] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.037301] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.037511] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.056541] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c90bbe47-7f68-400a-a228-2030ba9cad31 in Status: IN_PROGRESS for 2s [ 840.486729] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4e234e08-a192-4c7a-badf-3e57629854d7',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 840.989864] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4e234e08-a192-4c7a-badf-3e57629854d7',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 841.408164] env[65306]: INFO networking_nsxv3.common.synchronization [req-815b57f0-535f-468e-95bc-4f204bbe35c2 req-9e81e8b5-6b5c-41bd-94a5-d715475cd55e tempest-ServersAdminTestJSON-2076938379 tempest-ServersAdminTestJSON-2076938379-project-member] Enqueued Resource ID: 56904b3c-38e4-4547-9a1d-cc787c3fef9d with Priority: HIGHEST for action security_group_members [ 841.408882] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 56904b3c-38e4-4547-9a1d-cc787c3fef9d with Priority: HIGHEST for action security_group_members [ 841.409281] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-56904b3c-38e4-4547-9a1d-cc787c3fef9d taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.409432] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-56904b3c-38e4-4547-9a1d-cc787c3fef9d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.409512] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-56904b3c-38e4-4547-9a1d-cc787c3fef9d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.409765] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-56904b3c-38e4-4547-9a1d-cc787c3fef9d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.409939] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.410029] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.410133] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.410244] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.410328] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.410422] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('56904b3c-38e4-4547-9a1d-cc787c3fef9d',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 841.494182] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.494182] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.494298] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.495418] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.495418] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.495418] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4e234e08-a192-4c7a-badf-3e57629854d7 is going to be updated. [ 841.527666] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.527666] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.527666] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.528119] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.528119] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.537523] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4e234e08-a192-4c7a-badf-3e57629854d7 in Status: IN_PROGRESS for 2s [ 841.710562] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock network-705 taken with stack trace [, , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.710772] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "network-705" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.710897] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "network-705" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.711247] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "network-705" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.711514] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.711653] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.711765] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.711978] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.712191] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.712400] env[65306]: DEBUG dogpile.cache.region [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] No value present for key: 'zone-id' {{(pid=65306) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 841.712510] env[65306]: DEBUG dogpile.lock [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] NeedRegenerationException {{(pid=65306) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 841.712620] env[65306]: DEBUG dogpile.lock [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] no value, waiting for create lock {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 841.712725] env[65306]: DEBUG dogpile.lock [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] value creation lock acquired {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 841.712854] env[65306]: DEBUG dogpile.cache.region [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] No value present for key: 'zone-id' {{(pid=65306) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 841.712969] env[65306]: DEBUG dogpile.lock [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Calling creation function for not-yet-present value {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 841.713117] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 841.734793] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 841.734996] env[65306]: DEBUG dogpile.cache.region [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65306) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 841.735181] env[65306]: DEBUG dogpile.lock [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Released creation lock {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 841.735374] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "network-705" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.735704] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock port-0129ba25-f310-4d9e-b4c8-379fd2e68a52 taken with stack trace [, , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.735898] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "port-0129ba25-f310-4d9e-b4c8-379fd2e68a52" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.736089] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "port-0129ba25-f310-4d9e-b4c8-379fd2e68a52" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.736425] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "port-0129ba25-f310-4d9e-b4c8-379fd2e68a52" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.736563] env[65306]: DEBUG networking_nsxv3.api.rpc [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0129ba25-f310-4d9e-b4c8-379fd2e68a52',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 841.913585] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.913785] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.913877] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.914330] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.914330] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.914477] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.914606] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.914720] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.914893] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.914978] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.915111] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 56904b3c-38e4-4547-9a1d-cc787c3fef9d already deleted. [ 841.915200] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-56904b3c-38e4-4547-9a1d-cc787c3fef9d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.074975] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c90bbe47-7f68-400a-a228-2030ba9cad31 in Status: SUCCESS [ 842.075441] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c90bbe47-7f68-400a-a228-2030ba9cad31" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.239168] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.239471] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.239700] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.239977] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.240193] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.240889] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Segment Port 0129ba25-f310-4d9e-b4c8-379fd2e68a52 not found, creating... [ 842.240889] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.241084] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.241154] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.241513] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.241802] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.242146] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.242306] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.242420] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.242672] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.242841] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.242993] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Resource: SegmentPort with ID: 0129ba25-f310-4d9e-b4c8-379fd2e68a52 is going to be created. [ 842.267758] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.267970] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.268107] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.268379] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.268616] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.268830] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "port-0129ba25-f310-4d9e-b4c8-379fd2e68a52" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.986019] env[65306]: INFO networking_nsxv3.common.synchronization [req-815b57f0-535f-468e-95bc-4f204bbe35c2 req-f1706e7c-dcc0-4715-ba05-b132f48ccbe3 service nova] Enqueued Resource ID: 56904b3c-38e4-4547-9a1d-cc787c3fef9d with Priority: HIGHEST for action security_group_rules [ 842.986019] env[65306]: INFO networking_nsxv3.common.synchronization [req-815b57f0-535f-468e-95bc-4f204bbe35c2 req-f1706e7c-dcc0-4715-ba05-b132f48ccbe3 service nova] Enqueued Resource ID: 56904b3c-38e4-4547-9a1d-cc787c3fef9d with Priority: HIGHEST for action security_group_members [ 842.986019] env[65306]: INFO networking_nsxv3.common.synchronization [req-815b57f0-535f-468e-95bc-4f204bbe35c2 req-f1706e7c-dcc0-4715-ba05-b132f48ccbe3 service nova] Enqueued Resource ID: 0129ba25-f310-4d9e-b4c8-379fd2e68a52 with Priority: HIGHEST for action port [ 842.986019] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 56904b3c-38e4-4547-9a1d-cc787c3fef9d with Priority: HIGHEST for action security_group_rules [ 842.986019] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 56904b3c-38e4-4547-9a1d-cc787c3fef9d with Priority: HIGHEST for action security_group_members [ 842.986019] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0129ba25-f310-4d9e-b4c8-379fd2e68a52 with Priority: HIGHEST for action port [ 842.986019] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock rules-56904b3c-38e4-4547-9a1d-cc787c3fef9d taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.986019] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-56904b3c-38e4-4547-9a1d-cc787c3fef9d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.986019] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-56904b3c-38e4-4547-9a1d-cc787c3fef9d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.986019] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-56904b3c-38e4-4547-9a1d-cc787c3fef9d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.986019] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('56904b3c-38e4-4547-9a1d-cc787c3fef9d',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 842.986681] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-56904b3c-38e4-4547-9a1d-cc787c3fef9d taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.986739] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-56904b3c-38e4-4547-9a1d-cc787c3fef9d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.986776] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-56904b3c-38e4-4547-9a1d-cc787c3fef9d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.986961] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-56904b3c-38e4-4547-9a1d-cc787c3fef9d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.987240] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.987349] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.987412] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.987567] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.987652] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.987747] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('56904b3c-38e4-4547-9a1d-cc787c3fef9d',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 842.989530] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock port-0129ba25-f310-4d9e-b4c8-379fd2e68a52 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.989530] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0129ba25-f310-4d9e-b4c8-379fd2e68a52" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.989644] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0129ba25-f310-4d9e-b4c8-379fd2e68a52" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.989758] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0129ba25-f310-4d9e-b4c8-379fd2e68a52" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.989839] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0129ba25-f310-4d9e-b4c8-379fd2e68a52',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 843.487394] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-56904b3c-38e4-4547-9a1d-cc787c3fef9d taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.487835] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-56904b3c-38e4-4547-9a1d-cc787c3fef9d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.490122] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('56904b3c-38e4-4547-9a1d-cc787c3fef9d',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 843.492419] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0129ba25-f310-4d9e-b4c8-379fd2e68a52 with status ACTIVE [ 843.492419] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.492419] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.492419] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.492638] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.492638] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.492749] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.492903] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.492903] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.493045] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.493123] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.493301] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.493393] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.493456] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.493592] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.493661] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.493761] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0129ba25-f310-4d9e-b4c8-379fd2e68a52 is going to be updated. [ 843.515906] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.516349] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.516349] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.516349] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.516481] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.516808] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0129ba25-f310-4d9e-b4c8-379fd2e68a52" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.548032] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4e234e08-a192-4c7a-badf-3e57629854d7 in Status: SUCCESS [ 843.548032] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4e234e08-a192-4c7a-badf-3e57629854d7" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.548255] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4e234e08-a192-4c7a-badf-3e57629854d7" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.548516] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4e234e08-a192-4c7a-badf-3e57629854d7" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.549794] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.549794] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.549794] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.549794] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.549794] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.549794] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4e234e08-a192-4c7a-badf-3e57629854d7" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.549794] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4e234e08-a192-4c7a-badf-3e57629854d7',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 843.993698] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('56904b3c-38e4-4547-9a1d-cc787c3fef9d',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.051966] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-4e234e08-a192-4c7a-badf-3e57629854d7 taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.052367] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4e234e08-a192-4c7a-badf-3e57629854d7" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.052469] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4e234e08-a192-4c7a-badf-3e57629854d7" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.052790] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4e234e08-a192-4c7a-badf-3e57629854d7" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.053131] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.054794] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.054927] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.055136] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.055246] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.055340] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4e234e08-a192-4c7a-badf-3e57629854d7" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.055487] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-4e234e08-a192-4c7a-badf-3e57629854d7 taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.055598] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4e234e08-a192-4c7a-badf-3e57629854d7" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.055679] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4e234e08-a192-4c7a-badf-3e57629854d7" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.055835] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4e234e08-a192-4c7a-badf-3e57629854d7" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.055978] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.056109] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.056166] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.056446] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.056545] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.056635] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4e234e08-a192-4c7a-badf-3e57629854d7" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.056792] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4e234e08-a192-4c7a-badf-3e57629854d7',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.498779] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.498779] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.498779] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.499153] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.499153] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.499153] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 56904b3c-38e4-4547-9a1d-cc787c3fef9d is going to be created. [ 844.526017] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.526017] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.526017] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.526017] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.526017] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.541214] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 56904b3c-38e4-4547-9a1d-cc787c3fef9d in Status: UNINITIALIZED for 2s [ 844.559716] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4e234e08-a192-4c7a-badf-3e57629854d7: rpc.has_security_group_logging(os_id): False [ 844.578361] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.578560] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.578634] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.578890] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.599698] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.599902] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.600041] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.600114] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.600319] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.600529] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.600724] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.600832] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.600938] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.601084] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.601164] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.601355] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.601452] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.601517] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.601673] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.601795] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.601838] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4e234e08-a192-4c7a-badf-3e57629854d7 is going to be updated. [ 844.671216] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.671216] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.671430] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.671519] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.671651] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.687796] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4e234e08-a192-4c7a-badf-3e57629854d7 in Status: IN_PROGRESS for 2s [ 845.296219] env[65306]: INFO networking_nsxv3.common.synchronization [req-5a8017d2-9573-4913-8f8b-8ec9b90133e8 req-cf2f0d49-184e-480f-b884-75e292ecc78e tempest-ServersAdminTestJSON-2076938379 tempest-ServersAdminTestJSON-2076938379-project-member] Enqueued Resource ID: 56904b3c-38e4-4547-9a1d-cc787c3fef9d with Priority: HIGHEST for action security_group_members [ 845.296807] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 56904b3c-38e4-4547-9a1d-cc787c3fef9d with Priority: HIGHEST for action security_group_members [ 845.297146] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-56904b3c-38e4-4547-9a1d-cc787c3fef9d taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.297307] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-56904b3c-38e4-4547-9a1d-cc787c3fef9d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.666727] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock network-705 taken with stack trace [, , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.667031] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "network-705" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.667096] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "network-705" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.667656] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "network-705" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.667920] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.668287] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.668287] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.668527] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.668694] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.669064] env[65306]: DEBUG dogpile.cache.region [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] No value present for key: 'zone-id' {{(pid=65306) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 845.669419] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] NeedRegenerationException {{(pid=65306) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 845.669419] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] no value, waiting for create lock {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 845.669674] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] value creation lock acquired {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 845.669800] env[65306]: DEBUG dogpile.cache.region [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] No value present for key: 'zone-id' {{(pid=65306) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 845.669908] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Calling creation function for not-yet-present value {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 845.670056] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 845.689246] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 845.689386] env[65306]: DEBUG dogpile.cache.region [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=65306) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 845.689534] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Released creation lock {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 845.689728] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "network-705" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.690357] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock port-2f57b368-01d6-4c13-ad1e-5588b84ce740 taken with stack trace [, , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.690357] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "port-2f57b368-01d6-4c13-ad1e-5588b84ce740" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.690357] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "port-2f57b368-01d6-4c13-ad1e-5588b84ce740" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.690683] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "port-2f57b368-01d6-4c13-ad1e-5588b84ce740" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.690825] env[65306]: DEBUG networking_nsxv3.api.rpc [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2f57b368-01d6-4c13-ad1e-5588b84ce740',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 846.193536] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.193786] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.193911] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.194247] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.194372] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.194526] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Segment Port 2f57b368-01d6-4c13-ad1e-5588b84ce740 not found, creating... [ 846.194791] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.194940] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.195067] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.195282] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.195417] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.195691] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.195847] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.195958] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.196178] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.196307] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.196441] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Resource: SegmentPort with ID: 2f57b368-01d6-4c13-ad1e-5588b84ce740 is going to be created. [ 846.227468] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.227670] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.227788] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.228068] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.228290] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.228551] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "port-2f57b368-01d6-4c13-ad1e-5588b84ce740" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.551892] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 56904b3c-38e4-4547-9a1d-cc787c3fef9d in Status: SUCCESS [ 846.552098] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-56904b3c-38e4-4547-9a1d-cc787c3fef9d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.552264] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-56904b3c-38e4-4547-9a1d-cc787c3fef9d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.552480] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-56904b3c-38e4-4547-9a1d-cc787c3fef9d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.552671] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.552786] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.552844] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.553010] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.553094] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.553180] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-56904b3c-38e4-4547-9a1d-cc787c3fef9d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.553276] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('56904b3c-38e4-4547-9a1d-cc787c3fef9d',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 846.554752] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-56904b3c-38e4-4547-9a1d-cc787c3fef9d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.555134] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-56904b3c-38e4-4547-9a1d-cc787c3fef9d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.555339] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.555473] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.555559] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.555739] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.555862] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.555973] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('56904b3c-38e4-4547-9a1d-cc787c3fef9d',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 846.704753] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4e234e08-a192-4c7a-badf-3e57629854d7 in Status: SUCCESS [ 846.705188] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4e234e08-a192-4c7a-badf-3e57629854d7" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.953496] env[65306]: INFO networking_nsxv3.common.synchronization [req-5a8017d2-9573-4913-8f8b-8ec9b90133e8 req-c063d679-9094-4e6d-be07-847b85d7bdb5 service nova] Enqueued Resource ID: 56904b3c-38e4-4547-9a1d-cc787c3fef9d with Priority: HIGHEST for action security_group_rules [ 846.953496] env[65306]: INFO networking_nsxv3.common.synchronization [req-5a8017d2-9573-4913-8f8b-8ec9b90133e8 req-c063d679-9094-4e6d-be07-847b85d7bdb5 service nova] Enqueued Resource ID: 56904b3c-38e4-4547-9a1d-cc787c3fef9d with Priority: HIGHEST for action security_group_members [ 846.953496] env[65306]: INFO networking_nsxv3.common.synchronization [req-5a8017d2-9573-4913-8f8b-8ec9b90133e8 req-c063d679-9094-4e6d-be07-847b85d7bdb5 service nova] Enqueued Resource ID: 2f57b368-01d6-4c13-ad1e-5588b84ce740 with Priority: HIGHEST for action port [ 846.953684] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 56904b3c-38e4-4547-9a1d-cc787c3fef9d with Priority: HIGHEST for action security_group_rules [ 846.953723] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 56904b3c-38e4-4547-9a1d-cc787c3fef9d with Priority: HIGHEST for action security_group_members [ 846.953805] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2f57b368-01d6-4c13-ad1e-5588b84ce740 with Priority: HIGHEST for action port [ 846.954241] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock rules-56904b3c-38e4-4547-9a1d-cc787c3fef9d taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.954758] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-56904b3c-38e4-4547-9a1d-cc787c3fef9d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.954758] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-56904b3c-38e4-4547-9a1d-cc787c3fef9d taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.954758] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-56904b3c-38e4-4547-9a1d-cc787c3fef9d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.954944] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock port-2f57b368-01d6-4c13-ad1e-5588b84ce740 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.955073] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2f57b368-01d6-4c13-ad1e-5588b84ce740" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.955137] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2f57b368-01d6-4c13-ad1e-5588b84ce740" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.955343] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2f57b368-01d6-4c13-ad1e-5588b84ce740" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.955419] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2f57b368-01d6-4c13-ad1e-5588b84ce740',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 847.055815] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-56904b3c-38e4-4547-9a1d-cc787c3fef9d taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.056097] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-56904b3c-38e4-4547-9a1d-cc787c3fef9d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.058403] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('56904b3c-38e4-4547-9a1d-cc787c3fef9d',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 847.457591] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2f57b368-01d6-4c13-ad1e-5588b84ce740 with status ACTIVE [ 847.459942] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.459942] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.459942] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.459942] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.459942] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.459942] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.459942] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.459942] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.459942] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.459942] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.459942] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.459942] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.459942] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.459942] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.459942] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.459942] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2f57b368-01d6-4c13-ad1e-5588b84ce740 is going to be updated. [ 847.486484] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.486631] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.486752] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.486909] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.488185] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.488568] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2f57b368-01d6-4c13-ad1e-5588b84ce740" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.561594] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('56904b3c-38e4-4547-9a1d-cc787c3fef9d',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 848.010888] env[65306]: INFO networking_nsxv3.common.synchronization [req-b4aa2b01-c616-493f-87fb-760572ab348f req-f692be19-4418-4983-88de-ce5ef5ed9f94 tempest-ImagesOneServerNegativeTestJSON-105192947 tempest-ImagesOneServerNegativeTestJSON-105192947-project-member] Enqueued Resource ID: aceee07e-3675-474c-96e8-9fe510f1356f with Priority: HIGHEST for action security_group_members [ 848.011871] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aceee07e-3675-474c-96e8-9fe510f1356f with Priority: HIGHEST for action security_group_members [ 848.012293] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-aceee07e-3675-474c-96e8-9fe510f1356f taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.012486] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aceee07e-3675-474c-96e8-9fe510f1356f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.012486] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aceee07e-3675-474c-96e8-9fe510f1356f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.012713] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aceee07e-3675-474c-96e8-9fe510f1356f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.012881] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.012980] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.012980] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.013098] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.013317] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.013317] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('aceee07e-3675-474c-96e8-9fe510f1356f',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 848.065095] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.065095] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.065095] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.065095] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.065095] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.065095] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 56904b3c-38e4-4547-9a1d-cc787c3fef9d is going to be updated. [ 848.099314] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.099528] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.099528] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.099724] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.099870] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.112360] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 56904b3c-38e4-4547-9a1d-cc787c3fef9d in Status: IN_PROGRESS for 2s [ 848.518419] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.518419] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.518419] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.519215] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.519880] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.520072] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.520181] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.520301] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.520605] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.520957] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.520957] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aceee07e-3675-474c-96e8-9fe510f1356f is going to be deleted. [ 848.560419] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.560669] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.560728] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.560952] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.561086] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.561232] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aceee07e-3675-474c-96e8-9fe510f1356f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.810759] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock network-645 taken with stack trace [, , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.811467] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "network-645" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.811467] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "network-645" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.811467] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "network-645" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.811959] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.812187] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.812268] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.812468] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.812623] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.812832] env[65306]: DEBUG dogpile.cache.region [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] No value present for key: 'zone-id' {{(pid=65306) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 848.812943] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] NeedRegenerationException {{(pid=65306) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 848.813060] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] no value, waiting for create lock {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 848.813169] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] value creation lock acquired {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 848.813278] env[65306]: DEBUG dogpile.cache.region [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] No value present for key: 'zone-id' {{(pid=65306) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 848.813382] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Calling creation function for not-yet-present value {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 848.813515] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 848.833145] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 848.833268] env[65306]: DEBUG dogpile.cache.region [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65306) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 848.833403] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Released creation lock {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 848.833588] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "network-645" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.833889] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock port-33b9f09e-c6ce-4155-adbf-37e44b008d31 taken with stack trace [, , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.834073] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "port-33b9f09e-c6ce-4155-adbf-37e44b008d31" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.834193] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "port-33b9f09e-c6ce-4155-adbf-37e44b008d31" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.834565] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "port-33b9f09e-c6ce-4155-adbf-37e44b008d31" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.834707] env[65306]: DEBUG networking_nsxv3.api.rpc [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('33b9f09e-c6ce-4155-adbf-37e44b008d31',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 849.337537] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.337874] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.337934] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.338245] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.338399] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.338580] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Segment Port 33b9f09e-c6ce-4155-adbf-37e44b008d31 not found, creating... [ 849.338995] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.338995] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.339153] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.339350] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.339489] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.339790] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.339980] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.340309] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.340379] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.340480] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.340640] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Resource: SegmentPort with ID: 33b9f09e-c6ce-4155-adbf-37e44b008d31 is going to be created. [ 849.365033] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.365274] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.365514] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.365672] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.365910] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.366281] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "port-33b9f09e-c6ce-4155-adbf-37e44b008d31" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.123889] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 56904b3c-38e4-4547-9a1d-cc787c3fef9d in Status: SUCCESS [ 850.124205] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-56904b3c-38e4-4547-9a1d-cc787c3fef9d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.124417] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-56904b3c-38e4-4547-9a1d-cc787c3fef9d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.124950] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-56904b3c-38e4-4547-9a1d-cc787c3fef9d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.124950] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.125252] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.125252] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.125444] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.125587] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.125750] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('56904b3c-38e4-4547-9a1d-cc787c3fef9d',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 850.225371] env[65306]: INFO networking_nsxv3.common.synchronization [req-b4aa2b01-c616-493f-87fb-760572ab348f req-e3889151-17ba-443f-b27d-7192dd1321cd service nova] Enqueued Resource ID: aceee07e-3675-474c-96e8-9fe510f1356f with Priority: HIGHEST for action security_group_rules [ 850.225371] env[65306]: INFO networking_nsxv3.common.synchronization [req-b4aa2b01-c616-493f-87fb-760572ab348f req-e3889151-17ba-443f-b27d-7192dd1321cd service nova] Enqueued Resource ID: aceee07e-3675-474c-96e8-9fe510f1356f with Priority: HIGHEST for action security_group_members [ 850.225554] env[65306]: INFO networking_nsxv3.common.synchronization [req-b4aa2b01-c616-493f-87fb-760572ab348f req-e3889151-17ba-443f-b27d-7192dd1321cd service nova] Enqueued Resource ID: 33b9f09e-c6ce-4155-adbf-37e44b008d31 with Priority: HIGHEST for action port [ 850.227715] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aceee07e-3675-474c-96e8-9fe510f1356f with Priority: HIGHEST for action security_group_rules [ 850.227909] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aceee07e-3675-474c-96e8-9fe510f1356f with Priority: HIGHEST for action security_group_members [ 850.228080] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 33b9f09e-c6ce-4155-adbf-37e44b008d31 with Priority: HIGHEST for action port [ 850.232025] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock rules-aceee07e-3675-474c-96e8-9fe510f1356f taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.232025] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-aceee07e-3675-474c-96e8-9fe510f1356f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.232025] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-aceee07e-3675-474c-96e8-9fe510f1356f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.232025] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-aceee07e-3675-474c-96e8-9fe510f1356f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.232025] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('aceee07e-3675-474c-96e8-9fe510f1356f',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 850.232025] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-aceee07e-3675-474c-96e8-9fe510f1356f taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.232025] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aceee07e-3675-474c-96e8-9fe510f1356f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.232025] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aceee07e-3675-474c-96e8-9fe510f1356f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.232025] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aceee07e-3675-474c-96e8-9fe510f1356f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.232025] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.232025] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.232025] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.232025] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.232025] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.232025] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('aceee07e-3675-474c-96e8-9fe510f1356f',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 850.234210] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock port-33b9f09e-c6ce-4155-adbf-37e44b008d31 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.234348] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-33b9f09e-c6ce-4155-adbf-37e44b008d31" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.234397] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-33b9f09e-c6ce-4155-adbf-37e44b008d31" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.234557] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-33b9f09e-c6ce-4155-adbf-37e44b008d31" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.234640] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('33b9f09e-c6ce-4155-adbf-37e44b008d31',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 850.631413] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('56904b3c-38e4-4547-9a1d-cc787c3fef9d',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 850.736360] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-aceee07e-3675-474c-96e8-9fe510f1356f taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.736643] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aceee07e-3675-474c-96e8-9fe510f1356f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.736934] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('aceee07e-3675-474c-96e8-9fe510f1356f',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 850.737950] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 33b9f09e-c6ce-4155-adbf-37e44b008d31 with status ACTIVE [ 850.740345] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.740345] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.740345] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.740345] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.740345] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.740345] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.740345] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.740345] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.740345] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.740345] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.740345] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.740345] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.740345] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.740345] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.740345] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.740345] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 33b9f09e-c6ce-4155-adbf-37e44b008d31 is going to be updated. [ 850.765176] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.765407] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.765697] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.765991] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.766670] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.766670] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-33b9f09e-c6ce-4155-adbf-37e44b008d31" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.133915] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('56904b3c-38e4-4547-9a1d-cc787c3fef9d',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 851.242799] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('aceee07e-3675-474c-96e8-9fe510f1356f',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 851.607597] env[65306]: INFO networking_nsxv3.common.synchronization [req-d4d5f96c-cc84-489a-a040-29e22257754b req-d390ffcd-ec54-44dd-a840-d1bf8143ebcd tempest-ServerDiagnosticsNegativeTest-493131972 tempest-ServerDiagnosticsNegativeTest-493131972-project-member] Enqueued Resource ID: dbcb04c7-d4cb-4ab9-8312-c80dffeeaa42 with Priority: HIGHEST for action security_group_members [ 851.608177] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dbcb04c7-d4cb-4ab9-8312-c80dffeeaa42 with Priority: HIGHEST for action security_group_members [ 851.608488] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-dbcb04c7-d4cb-4ab9-8312-c80dffeeaa42 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.608626] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dbcb04c7-d4cb-4ab9-8312-c80dffeeaa42" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.612068] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dbcb04c7-d4cb-4ab9-8312-c80dffeeaa42" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.612068] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dbcb04c7-d4cb-4ab9-8312-c80dffeeaa42" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.612068] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.612068] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.612068] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.612068] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.612068] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.612068] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dbcb04c7-d4cb-4ab9-8312-c80dffeeaa42',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 851.637188] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.637188] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.637188] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.637188] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.637188] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.637188] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 56904b3c-38e4-4547-9a1d-cc787c3fef9d is going to be updated. [ 851.668367] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.668534] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.668586] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.668790] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.669146] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.680615] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 56904b3c-38e4-4547-9a1d-cc787c3fef9d in Status: IN_PROGRESS for 2s [ 851.746342] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.746504] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.746580] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.746775] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.746865] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.746969] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aceee07e-3675-474c-96e8-9fe510f1356f is going to be created. [ 851.781862] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.782104] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.782218] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.782453] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.782626] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.797120] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aceee07e-3675-474c-96e8-9fe510f1356f in Status: UNINITIALIZED for 2s [ 852.111989] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.111989] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.112742] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.113752] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.113897] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.114162] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.114588] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.114588] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.114588] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.114745] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.114745] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dbcb04c7-d4cb-4ab9-8312-c80dffeeaa42 already deleted. [ 852.114817] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dbcb04c7-d4cb-4ab9-8312-c80dffeeaa42" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.122576] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock network-707 taken with stack trace [, , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.122747] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "network-707" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.122854] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "network-707" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.123153] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "network-707" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.123444] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.123628] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.124083] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.124083] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.124240] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.124384] env[65306]: DEBUG dogpile.cache.region [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] No value present for key: 'zone-id' {{(pid=65306) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 852.125491] env[65306]: DEBUG dogpile.lock [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] NeedRegenerationException {{(pid=65306) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 852.125491] env[65306]: DEBUG dogpile.lock [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] no value, waiting for create lock {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 852.125491] env[65306]: DEBUG dogpile.lock [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] value creation lock acquired {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 852.125491] env[65306]: DEBUG dogpile.cache.region [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] No value present for key: 'zone-id' {{(pid=65306) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 852.125491] env[65306]: DEBUG dogpile.lock [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Calling creation function for not-yet-present value {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 852.125491] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 852.144608] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 852.144793] env[65306]: DEBUG dogpile.cache.region [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65306) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 852.144893] env[65306]: DEBUG dogpile.lock [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Released creation lock {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 852.145080] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "network-707" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.145393] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock port-6ec8c8b8-8321-4848-b363-46687cd94080 taken with stack trace [, , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.145651] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "port-6ec8c8b8-8321-4848-b363-46687cd94080" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.145729] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "port-6ec8c8b8-8321-4848-b363-46687cd94080" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.146329] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "port-6ec8c8b8-8321-4848-b363-46687cd94080" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.146329] env[65306]: DEBUG networking_nsxv3.api.rpc [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6ec8c8b8-8321-4848-b363-46687cd94080',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 852.546763] env[65306]: INFO networking_nsxv3.common.synchronization [None req-79f57ca8-8a00-41fc-9c42-59bd7c33ddc4 None None] Enqueued Resource ID: 28273038-af21-422d-9a5f-c4b377d26c9b with Priority: HIGHEST for action port [ 852.547646] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 28273038-af21-422d-9a5f-c4b377d26c9b with Priority: HIGHEST for action port [ 852.547958] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock port-28273038-af21-422d-9a5f-c4b377d26c9b taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.548102] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-28273038-af21-422d-9a5f-c4b377d26c9b" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.548208] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-28273038-af21-422d-9a5f-c4b377d26c9b" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.548434] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-28273038-af21-422d-9a5f-c4b377d26c9b" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.548529] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('28273038-af21-422d-9a5f-c4b377d26c9b',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 852.648228] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.648595] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.648684] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.649185] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.649289] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.649388] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Segment Port 6ec8c8b8-8321-4848-b363-46687cd94080 not found, creating... [ 852.649671] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.649855] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.649973] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.650221] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.650385] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.650688] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.650852] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.650966] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.651192] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.651323] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.651460] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Resource: SegmentPort with ID: 6ec8c8b8-8321-4848-b363-46687cd94080 is going to be created. [ 852.670931] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.671149] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.671267] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.671526] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.671746] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.671969] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "port-6ec8c8b8-8321-4848-b363-46687cd94080" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.051538] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 28273038-af21-422d-9a5f-c4b377d26c9b [ 853.051538] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.051774] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.051774] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.052373] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.052373] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.052373] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:28273038-af21-422d-9a5f-c4b377d26c9b already deleted. [ 853.052373] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-28273038-af21-422d-9a5f-c4b377d26c9b" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.429296] env[65306]: INFO networking_nsxv3.common.synchronization [req-d4d5f96c-cc84-489a-a040-29e22257754b req-1a636164-6e50-4786-91db-75b2c2ff5d20 service nova] Enqueued Resource ID: dbcb04c7-d4cb-4ab9-8312-c80dffeeaa42 with Priority: HIGHEST for action security_group_rules [ 853.429664] env[65306]: INFO networking_nsxv3.common.synchronization [req-d4d5f96c-cc84-489a-a040-29e22257754b req-1a636164-6e50-4786-91db-75b2c2ff5d20 service nova] Enqueued Resource ID: dbcb04c7-d4cb-4ab9-8312-c80dffeeaa42 with Priority: HIGHEST for action security_group_members [ 853.429909] env[65306]: INFO networking_nsxv3.common.synchronization [req-d4d5f96c-cc84-489a-a040-29e22257754b req-1a636164-6e50-4786-91db-75b2c2ff5d20 service nova] Enqueued Resource ID: 6ec8c8b8-8321-4848-b363-46687cd94080 with Priority: HIGHEST for action port [ 853.431409] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dbcb04c7-d4cb-4ab9-8312-c80dffeeaa42 with Priority: HIGHEST for action security_group_rules [ 853.431409] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dbcb04c7-d4cb-4ab9-8312-c80dffeeaa42 with Priority: HIGHEST for action security_group_members [ 853.431409] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6ec8c8b8-8321-4848-b363-46687cd94080 with Priority: HIGHEST for action port [ 853.431409] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock rules-dbcb04c7-d4cb-4ab9-8312-c80dffeeaa42 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.431409] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-dbcb04c7-d4cb-4ab9-8312-c80dffeeaa42" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.431409] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-dbcb04c7-d4cb-4ab9-8312-c80dffeeaa42" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.431856] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-dbcb04c7-d4cb-4ab9-8312-c80dffeeaa42" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.431856] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('dbcb04c7-d4cb-4ab9-8312-c80dffeeaa42',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 853.432596] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-dbcb04c7-d4cb-4ab9-8312-c80dffeeaa42 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.432709] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dbcb04c7-d4cb-4ab9-8312-c80dffeeaa42" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.432766] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dbcb04c7-d4cb-4ab9-8312-c80dffeeaa42" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.432941] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dbcb04c7-d4cb-4ab9-8312-c80dffeeaa42" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.433102] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.433204] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.433246] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.433385] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.433467] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.433557] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dbcb04c7-d4cb-4ab9-8312-c80dffeeaa42',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 853.436177] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock port-6ec8c8b8-8321-4848-b363-46687cd94080 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.436177] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6ec8c8b8-8321-4848-b363-46687cd94080" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.436177] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6ec8c8b8-8321-4848-b363-46687cd94080" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.436177] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6ec8c8b8-8321-4848-b363-46687cd94080" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.436177] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6ec8c8b8-8321-4848-b363-46687cd94080',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 853.694683] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 56904b3c-38e4-4547-9a1d-cc787c3fef9d in Status: SUCCESS [ 853.694967] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-56904b3c-38e4-4547-9a1d-cc787c3fef9d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.696386] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-56904b3c-38e4-4547-9a1d-cc787c3fef9d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.696764] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-56904b3c-38e4-4547-9a1d-cc787c3fef9d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.697278] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.699645] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.699645] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.699645] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.699645] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.699645] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-56904b3c-38e4-4547-9a1d-cc787c3fef9d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.699645] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-56904b3c-38e4-4547-9a1d-cc787c3fef9d taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.699645] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-56904b3c-38e4-4547-9a1d-cc787c3fef9d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.699645] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-56904b3c-38e4-4547-9a1d-cc787c3fef9d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.699645] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-56904b3c-38e4-4547-9a1d-cc787c3fef9d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.699645] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.699645] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.699645] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.699645] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.699645] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.699645] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-56904b3c-38e4-4547-9a1d-cc787c3fef9d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.699645] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('56904b3c-38e4-4547-9a1d-cc787c3fef9d',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 853.814400] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aceee07e-3675-474c-96e8-9fe510f1356f in Status: SUCCESS [ 853.814612] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aceee07e-3675-474c-96e8-9fe510f1356f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.815042] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aceee07e-3675-474c-96e8-9fe510f1356f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.815293] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aceee07e-3675-474c-96e8-9fe510f1356f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.815483] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.815597] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.815660] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.815823] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.817312] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.817471] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aceee07e-3675-474c-96e8-9fe510f1356f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.817536] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('aceee07e-3675-474c-96e8-9fe510f1356f',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 853.941860] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-dbcb04c7-d4cb-4ab9-8312-c80dffeeaa42 taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.941860] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dbcb04c7-d4cb-4ab9-8312-c80dffeeaa42" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.941860] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('dbcb04c7-d4cb-4ab9-8312-c80dffeeaa42',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 853.946391] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6ec8c8b8-8321-4848-b363-46687cd94080 with status ACTIVE [ 853.946986] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.946986] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.946986] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.947286] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.947411] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.947619] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.948394] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.948394] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.948394] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.948394] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.951019] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.951154] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.951301] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.951589] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.951589] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.951681] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6ec8c8b8-8321-4848-b363-46687cd94080 is going to be updated. [ 853.976075] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.976268] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.978733] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.979017] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.979183] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.979367] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6ec8c8b8-8321-4848-b363-46687cd94080" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.178700] env[65306]: INFO networking_nsxv3.common.synchronization [req-63072025-1d55-4e46-89d2-93fafadde8e3 req-667c30d3-ebcc-43a8-9173-e631040618b2 tempest-SecurityGroupsTestJSON-960025904 tempest-SecurityGroupsTestJSON-960025904-project-member] Enqueued Resource ID: 99194846-a5d9-4dff-8a78-5c66da2ee811 with Priority: HIGHEST for action security_group_members [ 854.179217] env[65306]: INFO networking_nsxv3.common.synchronization [req-63072025-1d55-4e46-89d2-93fafadde8e3 req-667c30d3-ebcc-43a8-9173-e631040618b2 tempest-SecurityGroupsTestJSON-960025904 tempest-SecurityGroupsTestJSON-960025904-project-member] Enqueued Resource ID: 4e234e08-a192-4c7a-badf-3e57629854d7 with Priority: HIGHEST for action security_group_members [ 854.179545] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 99194846-a5d9-4dff-8a78-5c66da2ee811 with Priority: HIGHEST for action security_group_members [ 854.179697] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4e234e08-a192-4c7a-badf-3e57629854d7 with Priority: HIGHEST for action security_group_members [ 854.180415] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-99194846-a5d9-4dff-8a78-5c66da2ee811 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.180531] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-99194846-a5d9-4dff-8a78-5c66da2ee811" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.180706] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-99194846-a5d9-4dff-8a78-5c66da2ee811" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.181640] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-99194846-a5d9-4dff-8a78-5c66da2ee811" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.181640] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.181640] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.181640] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.181640] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.181640] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.181856] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('99194846-a5d9-4dff-8a78-5c66da2ee811',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 854.183473] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-4e234e08-a192-4c7a-badf-3e57629854d7 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.183473] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4e234e08-a192-4c7a-badf-3e57629854d7" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.183657] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4e234e08-a192-4c7a-badf-3e57629854d7" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.184140] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4e234e08-a192-4c7a-badf-3e57629854d7" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.184299] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.184400] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.184472] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.184724] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.184816] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.184909] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4e234e08-a192-4c7a-badf-3e57629854d7',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 854.201742] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 56904b3c-38e4-4547-9a1d-cc787c3fef9d: rpc.has_security_group_logging(os_id): False [ 854.224587] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.224793] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.224845] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.225036] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.225129] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.225329] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.225445] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.225544] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.225608] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.225672] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.226549] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.226549] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.226549] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.226549] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.227030] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.227030] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.227030] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.227030] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.227199] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.227199] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.227348] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 56904b3c-38e4-4547-9a1d-cc787c3fef9d is going to be created. [ 854.236602] env[65306]: INFO networking_nsxv3.common.synchronization [req-63072025-1d55-4e46-89d2-93fafadde8e3 req-667c30d3-ebcc-43a8-9173-e631040618b2 tempest-SecurityGroupsTestJSON-960025904 tempest-SecurityGroupsTestJSON-960025904-project-member] Enqueued Resource ID: 4e234e08-a192-4c7a-badf-3e57629854d7 with Priority: HIGHEST for action security_group_rules [ 854.236710] env[65306]: INFO networking_nsxv3.common.synchronization [req-63072025-1d55-4e46-89d2-93fafadde8e3 req-667c30d3-ebcc-43a8-9173-e631040618b2 tempest-SecurityGroupsTestJSON-960025904 tempest-SecurityGroupsTestJSON-960025904-project-member] Enqueued Resource ID: 4e234e08-a192-4c7a-badf-3e57629854d7 with Priority: HIGHEST for action security_group_members [ 854.236888] env[65306]: INFO networking_nsxv3.common.synchronization [req-63072025-1d55-4e46-89d2-93fafadde8e3 req-667c30d3-ebcc-43a8-9173-e631040618b2 tempest-SecurityGroupsTestJSON-960025904 tempest-SecurityGroupsTestJSON-960025904-project-member] Enqueued Resource ID: 99194846-a5d9-4dff-8a78-5c66da2ee811 with Priority: HIGHEST for action security_group_rules [ 854.237089] env[65306]: INFO networking_nsxv3.common.synchronization [req-63072025-1d55-4e46-89d2-93fafadde8e3 req-667c30d3-ebcc-43a8-9173-e631040618b2 tempest-SecurityGroupsTestJSON-960025904 tempest-SecurityGroupsTestJSON-960025904-project-member] Enqueued Resource ID: 99194846-a5d9-4dff-8a78-5c66da2ee811 with Priority: HIGHEST for action security_group_members [ 854.237183] env[65306]: INFO networking_nsxv3.common.synchronization [req-63072025-1d55-4e46-89d2-93fafadde8e3 req-667c30d3-ebcc-43a8-9173-e631040618b2 tempest-SecurityGroupsTestJSON-960025904 tempest-SecurityGroupsTestJSON-960025904-project-member] Enqueued Resource ID: e02bffcf-337d-4619-9629-a50e2941c30d with Priority: HIGHEST for action port [ 854.237724] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4e234e08-a192-4c7a-badf-3e57629854d7 with Priority: HIGHEST for action security_group_rules [ 854.237862] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 99194846-a5d9-4dff-8a78-5c66da2ee811 with Priority: HIGHEST for action security_group_rules [ 854.239125] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e02bffcf-337d-4619-9629-a50e2941c30d with Priority: HIGHEST for action port [ 854.239285] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4e234e08-a192-4c7a-badf-3e57629854d7 with Priority: HIGHEST for action security_group_members [ 854.239539] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 99194846-a5d9-4dff-8a78-5c66da2ee811 with Priority: HIGHEST for action security_group_members [ 854.239818] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4e234e08-a192-4c7a-badf-3e57629854d7 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.240099] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4e234e08-a192-4c7a-badf-3e57629854d7" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.240099] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4e234e08-a192-4c7a-badf-3e57629854d7" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.240533] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4e234e08-a192-4c7a-badf-3e57629854d7" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.240533] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4e234e08-a192-4c7a-badf-3e57629854d7',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 854.241488] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock rules-99194846-a5d9-4dff-8a78-5c66da2ee811 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.241488] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-99194846-a5d9-4dff-8a78-5c66da2ee811" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.241488] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-99194846-a5d9-4dff-8a78-5c66da2ee811" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.243050] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-99194846-a5d9-4dff-8a78-5c66da2ee811" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.243050] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('99194846-a5d9-4dff-8a78-5c66da2ee811',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 854.243200] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock port-e02bffcf-337d-4619-9629-a50e2941c30d taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.243265] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e02bffcf-337d-4619-9629-a50e2941c30d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.243304] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e02bffcf-337d-4619-9629-a50e2941c30d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.243655] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e02bffcf-337d-4619-9629-a50e2941c30d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.243655] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e02bffcf-337d-4619-9629-a50e2941c30d',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 854.244269] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-4e234e08-a192-4c7a-badf-3e57629854d7 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.244431] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4e234e08-a192-4c7a-badf-3e57629854d7" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.244721] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-99194846-a5d9-4dff-8a78-5c66da2ee811 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.245221] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-99194846-a5d9-4dff-8a78-5c66da2ee811" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.301977] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.301977] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.301977] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.302620] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.302801] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.317307] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 56904b3c-38e4-4547-9a1d-cc787c3fef9d in Status: IN_PROGRESS for 2s [ 854.322387] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-aceee07e-3675-474c-96e8-9fe510f1356f taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.322387] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aceee07e-3675-474c-96e8-9fe510f1356f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.322387] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aceee07e-3675-474c-96e8-9fe510f1356f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.322387] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aceee07e-3675-474c-96e8-9fe510f1356f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.322387] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.322387] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.322387] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.322387] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.322886] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.322886] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aceee07e-3675-474c-96e8-9fe510f1356f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.322886] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-aceee07e-3675-474c-96e8-9fe510f1356f taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.323043] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aceee07e-3675-474c-96e8-9fe510f1356f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.323658] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aceee07e-3675-474c-96e8-9fe510f1356f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.323658] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aceee07e-3675-474c-96e8-9fe510f1356f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.323658] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.323658] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.323658] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.323930] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.323930] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.324072] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aceee07e-3675-474c-96e8-9fe510f1356f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.324147] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('aceee07e-3675-474c-96e8-9fe510f1356f',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 854.454533] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('dbcb04c7-d4cb-4ab9-8312-c80dffeeaa42',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 854.579508] env[65306]: INFO networking_nsxv3.common.synchronization [None req-049eeb00-8fc1-4b5d-9344-a10f4ade500e None None] Enqueued Resource ID: 9fe7520f-f422-4e28-86ce-038542cb150f with Priority: HIGHEST for action port [ 854.580125] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9fe7520f-f422-4e28-86ce-038542cb150f with Priority: HIGHEST for action port [ 854.580460] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock port-9fe7520f-f422-4e28-86ce-038542cb150f taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.580669] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9fe7520f-f422-4e28-86ce-038542cb150f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.580956] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9fe7520f-f422-4e28-86ce-038542cb150f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.581073] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9fe7520f-f422-4e28-86ce-038542cb150f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.581161] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9fe7520f-f422-4e28-86ce-038542cb150f',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 854.690018] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('99194846-a5d9-4dff-8a78-5c66da2ee811',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 854.691062] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4e234e08-a192-4c7a-badf-3e57629854d7',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 854.747878] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-4e234e08-a192-4c7a-badf-3e57629854d7 taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.747878] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4e234e08-a192-4c7a-badf-3e57629854d7" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.747878] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e02bffcf-337d-4619-9629-a50e2941c30d with status ACTIVE [ 854.748455] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.748455] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.748455] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.748577] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.748786] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.748930] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.749395] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.749582] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.749919] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.750168] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.750467] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.750754] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.750909] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.751181] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.751341] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.751485] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e02bffcf-337d-4619-9629-a50e2941c30d is going to be updated. [ 854.752797] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-99194846-a5d9-4dff-8a78-5c66da2ee811 taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.752953] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-99194846-a5d9-4dff-8a78-5c66da2ee811" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.775478] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.775772] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.776518] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.776772] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.777094] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.777630] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e02bffcf-337d-4619-9629-a50e2941c30d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.827218] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for aceee07e-3675-474c-96e8-9fe510f1356f: rpc.has_security_group_logging(os_id): False [ 854.847508] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.847761] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.847889] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.848134] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.848229] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.848456] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.848560] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.848643] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.848806] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.849091] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.849091] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.849184] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.849217] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.849386] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.849500] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.849785] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.849908] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.849974] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.850455] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.850663] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.850902] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: aceee07e-3675-474c-96e8-9fe510f1356f is going to be created. [ 854.957478] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.958192] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.958348] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.959054] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.959054] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.959054] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dbcb04c7-d4cb-4ab9-8312-c80dffeeaa42 is going to be created. [ 854.964600] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.965214] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.965401] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.967804] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.967804] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.985463] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: aceee07e-3675-474c-96e8-9fe510f1356f in Status: IN_PROGRESS for 2s [ 854.997492] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.997631] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.997709] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.998020] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.998234] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.022227] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dbcb04c7-d4cb-4ab9-8312-c80dffeeaa42 in Status: UNINITIALIZED for 2s [ 855.083696] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9fe7520f-f422-4e28-86ce-038542cb150f [ 855.084106] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.084247] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.084298] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.085405] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.085547] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.085694] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9fe7520f-f422-4e28-86ce-038542cb150f already deleted. [ 855.086446] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9fe7520f-f422-4e28-86ce-038542cb150f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.195300] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('99194846-a5d9-4dff-8a78-5c66da2ee811',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 855.195300] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4e234e08-a192-4c7a-badf-3e57629854d7',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 855.697093] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.697313] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.697396] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.698243] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.698408] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.698774] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 99194846-a5d9-4dff-8a78-5c66da2ee811 is going to be created. [ 855.700423] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.700578] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.700699] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.700903] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.700992] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.701132] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4e234e08-a192-4c7a-badf-3e57629854d7 is going to be updated. [ 855.730244] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.730399] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.730775] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.730880] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.731020] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.733926] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.734115] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.734218] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.734419] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.734576] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.743782] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 99194846-a5d9-4dff-8a78-5c66da2ee811 in Status: UNINITIALIZED for 2s [ 855.744471] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4e234e08-a192-4c7a-badf-3e57629854d7 in Status: IN_PROGRESS for 2s [ 855.777325] env[65306]: INFO networking_nsxv3.common.synchronization [req-4d851d9e-728d-4bd4-bd49-edd2f4243eb8 req-fc28f22f-db85-41e9-bc7b-0b0c3646e2f5 tempest-ServerPasswordTestJSON-1529732582 tempest-ServerPasswordTestJSON-1529732582-project-member] Enqueued Resource ID: b9d469db-f694-4408-9c06-70ff03328f59 with Priority: HIGHEST for action security_group_members [ 855.777903] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b9d469db-f694-4408-9c06-70ff03328f59 with Priority: HIGHEST for action security_group_members [ 855.778205] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-b9d469db-f694-4408-9c06-70ff03328f59 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.778325] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b9d469db-f694-4408-9c06-70ff03328f59" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.778398] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b9d469db-f694-4408-9c06-70ff03328f59" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.778811] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b9d469db-f694-4408-9c06-70ff03328f59" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.778978] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.779098] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.779164] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.779336] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.779422] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.779518] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b9d469db-f694-4408-9c06-70ff03328f59',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 856.282542] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.282721] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.282777] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.282989] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.283111] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.283299] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.283400] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.283458] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.283671] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.283716] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.283761] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b9d469db-f694-4408-9c06-70ff03328f59 already deleted. [ 856.283829] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b9d469db-f694-4408-9c06-70ff03328f59" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.335143] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 56904b3c-38e4-4547-9a1d-cc787c3fef9d in Status: SUCCESS [ 856.335406] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-56904b3c-38e4-4547-9a1d-cc787c3fef9d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.335592] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-56904b3c-38e4-4547-9a1d-cc787c3fef9d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.335812] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-56904b3c-38e4-4547-9a1d-cc787c3fef9d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.335904] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('56904b3c-38e4-4547-9a1d-cc787c3fef9d',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 856.509522] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock network-921 taken with stack trace [, , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.509793] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "network-921" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.509932] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "network-921" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.510368] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "network-921" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.510698] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.510868] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.510983] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.511546] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.511757] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.512082] env[65306]: DEBUG dogpile.cache.region [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] No value present for key: 'zone-id' {{(pid=65306) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 856.512249] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] NeedRegenerationException {{(pid=65306) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 856.512403] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] no value, waiting for create lock {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 856.512518] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] value creation lock acquired {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 856.512656] env[65306]: DEBUG dogpile.cache.region [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] No value present for key: 'zone-id' {{(pid=65306) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 856.512744] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Calling creation function for not-yet-present value {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 856.512882] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 856.535551] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 856.535551] env[65306]: DEBUG dogpile.cache.region [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65306) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 856.535551] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Released creation lock {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 856.535551] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "network-921" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.535812] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock port-b30213a8-3d11-47bd-a12b-ba4484512897 taken with stack trace [, , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.535982] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "port-b30213a8-3d11-47bd-a12b-ba4484512897" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.536108] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "port-b30213a8-3d11-47bd-a12b-ba4484512897" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.538546] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "port-b30213a8-3d11-47bd-a12b-ba4484512897" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.538546] env[65306]: DEBUG networking_nsxv3.api.rpc [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b30213a8-3d11-47bd-a12b-ba4484512897',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 856.702962] env[65306]: INFO networking_nsxv3.common.synchronization [None req-53ba958f-5eab-45b0-82b6-157754ffb668 None None] Enqueued Resource ID: 030f1cb7-1944-4379-9196-35eb2df1d83f with Priority: HIGHEST for action port [ 856.703442] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 030f1cb7-1944-4379-9196-35eb2df1d83f with Priority: HIGHEST for action port [ 856.703755] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock port-030f1cb7-1944-4379-9196-35eb2df1d83f taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.703908] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-030f1cb7-1944-4379-9196-35eb2df1d83f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.704045] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-030f1cb7-1944-4379-9196-35eb2df1d83f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.704709] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-030f1cb7-1944-4379-9196-35eb2df1d83f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.704709] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('030f1cb7-1944-4379-9196-35eb2df1d83f',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 856.837968] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-56904b3c-38e4-4547-9a1d-cc787c3fef9d taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.838405] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-56904b3c-38e4-4547-9a1d-cc787c3fef9d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.838405] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-56904b3c-38e4-4547-9a1d-cc787c3fef9d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.838405] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-56904b3c-38e4-4547-9a1d-cc787c3fef9d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.838655] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.838836] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.838836] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.839048] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.839235] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.839328] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-56904b3c-38e4-4547-9a1d-cc787c3fef9d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.839436] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('56904b3c-38e4-4547-9a1d-cc787c3fef9d',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 857.000432] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: aceee07e-3675-474c-96e8-9fe510f1356f in Status: SUCCESS [ 857.000729] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-aceee07e-3675-474c-96e8-9fe510f1356f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.033629] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dbcb04c7-d4cb-4ab9-8312-c80dffeeaa42 in Status: SUCCESS [ 857.034197] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dbcb04c7-d4cb-4ab9-8312-c80dffeeaa42" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.034305] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dbcb04c7-d4cb-4ab9-8312-c80dffeeaa42" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.034521] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dbcb04c7-d4cb-4ab9-8312-c80dffeeaa42" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.034811] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.035025] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.035025] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.035285] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.035285] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.035285] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dbcb04c7-d4cb-4ab9-8312-c80dffeeaa42" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.035378] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('dbcb04c7-d4cb-4ab9-8312-c80dffeeaa42',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 857.040320] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.040639] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.040738] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.040975] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.041175] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.041338] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Segment Port b30213a8-3d11-47bd-a12b-ba4484512897 not found, creating... [ 857.041594] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.041749] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.041865] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.042116] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.042266] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.042549] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.042709] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.042823] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.044654] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.045100] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.045275] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Resource: SegmentPort with ID: b30213a8-3d11-47bd-a12b-ba4484512897 is going to be created. [ 857.068865] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.069130] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.069248] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.069521] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.069755] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.070009] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "port-b30213a8-3d11-47bd-a12b-ba4484512897" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.207025] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 030f1cb7-1944-4379-9196-35eb2df1d83f [ 857.208701] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.208701] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.208701] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.208701] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.208701] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.208701] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:030f1cb7-1944-4379-9196-35eb2df1d83f already deleted. [ 857.208701] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-030f1cb7-1944-4379-9196-35eb2df1d83f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.342350] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-56904b3c-38e4-4547-9a1d-cc787c3fef9d taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.342698] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-56904b3c-38e4-4547-9a1d-cc787c3fef9d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.342698] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-56904b3c-38e4-4547-9a1d-cc787c3fef9d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.342798] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-56904b3c-38e4-4547-9a1d-cc787c3fef9d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.347938] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.347938] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.347938] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.347938] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.347938] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.347938] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-56904b3c-38e4-4547-9a1d-cc787c3fef9d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.347938] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-56904b3c-38e4-4547-9a1d-cc787c3fef9d taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.347938] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-56904b3c-38e4-4547-9a1d-cc787c3fef9d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.347938] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-56904b3c-38e4-4547-9a1d-cc787c3fef9d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.347938] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-56904b3c-38e4-4547-9a1d-cc787c3fef9d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.347938] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.347938] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.347938] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.347938] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.347938] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.347938] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-56904b3c-38e4-4547-9a1d-cc787c3fef9d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.347938] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('56904b3c-38e4-4547-9a1d-cc787c3fef9d',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 857.537997] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-dbcb04c7-d4cb-4ab9-8312-c80dffeeaa42 taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.537997] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dbcb04c7-d4cb-4ab9-8312-c80dffeeaa42" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.537997] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dbcb04c7-d4cb-4ab9-8312-c80dffeeaa42" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.537997] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dbcb04c7-d4cb-4ab9-8312-c80dffeeaa42" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.538526] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.538526] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.538748] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.538840] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.538971] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.539134] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dbcb04c7-d4cb-4ab9-8312-c80dffeeaa42" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.539323] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-dbcb04c7-d4cb-4ab9-8312-c80dffeeaa42 taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.539511] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dbcb04c7-d4cb-4ab9-8312-c80dffeeaa42" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.539630] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dbcb04c7-d4cb-4ab9-8312-c80dffeeaa42" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.539885] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dbcb04c7-d4cb-4ab9-8312-c80dffeeaa42" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.540107] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.540285] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.540341] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.540516] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.540660] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.540782] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dbcb04c7-d4cb-4ab9-8312-c80dffeeaa42" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.540908] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('dbcb04c7-d4cb-4ab9-8312-c80dffeeaa42',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 857.761214] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4e234e08-a192-4c7a-badf-3e57629854d7 in Status: SUCCESS [ 857.761395] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4e234e08-a192-4c7a-badf-3e57629854d7" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.761648] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4e234e08-a192-4c7a-badf-3e57629854d7" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.761910] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4e234e08-a192-4c7a-badf-3e57629854d7" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.762177] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.762317] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.762382] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.762574] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.762662] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.762764] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4e234e08-a192-4c7a-badf-3e57629854d7',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 857.765101] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 99194846-a5d9-4dff-8a78-5c66da2ee811 in Status: SUCCESS [ 857.765101] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-99194846-a5d9-4dff-8a78-5c66da2ee811" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.765101] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-99194846-a5d9-4dff-8a78-5c66da2ee811" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.765277] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-99194846-a5d9-4dff-8a78-5c66da2ee811" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.765467] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.765586] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.765666] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.765936] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.766062] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.766165] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('99194846-a5d9-4dff-8a78-5c66da2ee811',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 857.834542] env[65306]: INFO networking_nsxv3.common.synchronization [req-4d851d9e-728d-4bd4-bd49-edd2f4243eb8 req-79e801bb-e710-4833-b7a3-23d256680a7a service nova] Enqueued Resource ID: b9d469db-f694-4408-9c06-70ff03328f59 with Priority: HIGHEST for action security_group_rules [ 857.834542] env[65306]: INFO networking_nsxv3.common.synchronization [req-4d851d9e-728d-4bd4-bd49-edd2f4243eb8 req-79e801bb-e710-4833-b7a3-23d256680a7a service nova] Enqueued Resource ID: b9d469db-f694-4408-9c06-70ff03328f59 with Priority: HIGHEST for action security_group_members [ 857.834542] env[65306]: INFO networking_nsxv3.common.synchronization [req-4d851d9e-728d-4bd4-bd49-edd2f4243eb8 req-79e801bb-e710-4833-b7a3-23d256680a7a service nova] Enqueued Resource ID: b30213a8-3d11-47bd-a12b-ba4484512897 with Priority: HIGHEST for action port [ 857.834542] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b9d469db-f694-4408-9c06-70ff03328f59 with Priority: HIGHEST for action security_group_rules [ 857.834840] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b9d469db-f694-4408-9c06-70ff03328f59 with Priority: HIGHEST for action security_group_members [ 857.834840] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b30213a8-3d11-47bd-a12b-ba4484512897 with Priority: HIGHEST for action port [ 857.836514] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b9d469db-f694-4408-9c06-70ff03328f59 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.836658] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b9d469db-f694-4408-9c06-70ff03328f59" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.836728] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b9d469db-f694-4408-9c06-70ff03328f59" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.837013] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b9d469db-f694-4408-9c06-70ff03328f59" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.837103] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b9d469db-f694-4408-9c06-70ff03328f59',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 857.838427] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-b9d469db-f694-4408-9c06-70ff03328f59 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.838785] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b9d469db-f694-4408-9c06-70ff03328f59" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.838785] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b9d469db-f694-4408-9c06-70ff03328f59" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.838880] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b9d469db-f694-4408-9c06-70ff03328f59" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.839121] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.839251] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.839332] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.839520] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.839632] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.839771] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b9d469db-f694-4408-9c06-70ff03328f59',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 857.843457] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock port-b30213a8-3d11-47bd-a12b-ba4484512897 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.844765] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b30213a8-3d11-47bd-a12b-ba4484512897" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.844938] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b30213a8-3d11-47bd-a12b-ba4484512897" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.845200] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b30213a8-3d11-47bd-a12b-ba4484512897" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.845350] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b30213a8-3d11-47bd-a12b-ba4484512897',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 857.847726] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 56904b3c-38e4-4547-9a1d-cc787c3fef9d: rpc.has_security_group_logging(os_id): False [ 857.871140] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.871361] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.871478] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.871789] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.872024] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.872186] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.872340] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.872444] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.872687] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.872783] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.873131] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.873287] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.873392] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.873580] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.873706] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.873928] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.874281] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.874281] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.874281] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.874453] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.874578] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 56904b3c-38e4-4547-9a1d-cc787c3fef9d is going to be updated. [ 857.939309] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.939487] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.939574] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.939812] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.939987] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.955299] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 56904b3c-38e4-4547-9a1d-cc787c3fef9d in Status: IN_PROGRESS for 2s [ 858.043742] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for dbcb04c7-d4cb-4ab9-8312-c80dffeeaa42: rpc.has_security_group_logging(os_id): False [ 858.070582] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.070582] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.070582] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.070582] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.070582] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.070582] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.071129] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.071129] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.071129] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.071129] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.071334] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.071652] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.071652] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.075305] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.075462] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.076455] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.076455] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.076455] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.076455] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.076455] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.076455] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: dbcb04c7-d4cb-4ab9-8312-c80dffeeaa42 is going to be created. [ 858.148145] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.148294] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.148362] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.148574] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.148759] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.165737] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dbcb04c7-d4cb-4ab9-8312-c80dffeeaa42 in Status: IN_PROGRESS for 2s [ 858.271025] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4e234e08-a192-4c7a-badf-3e57629854d7',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 858.271025] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('99194846-a5d9-4dff-8a78-5c66da2ee811',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 858.348953] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-b9d469db-f694-4408-9c06-70ff03328f59 taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.348953] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b9d469db-f694-4408-9c06-70ff03328f59" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.348953] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b9d469db-f694-4408-9c06-70ff03328f59',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 858.350053] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b30213a8-3d11-47bd-a12b-ba4484512897 with status ACTIVE [ 858.350224] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.350333] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.350333] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.350512] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.350598] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.350851] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.350963] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.351039] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.351352] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.351352] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.351495] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.351581] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.351581] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.351720] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.353944] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.353944] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b30213a8-3d11-47bd-a12b-ba4484512897 is going to be updated. [ 858.382142] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.382349] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.382527] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.382739] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.382900] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.383098] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b30213a8-3d11-47bd-a12b-ba4484512897" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.773633] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('99194846-a5d9-4dff-8a78-5c66da2ee811',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 858.774745] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4e234e08-a192-4c7a-badf-3e57629854d7',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 858.851987] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b9d469db-f694-4408-9c06-70ff03328f59',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 859.276314] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.279811] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.279811] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.279811] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.279811] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.279811] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 99194846-a5d9-4dff-8a78-5c66da2ee811 is going to be updated. [ 859.279811] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.279811] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.280128] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.280128] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.283766] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.283766] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4e234e08-a192-4c7a-badf-3e57629854d7 is going to be updated. [ 859.330364] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.330574] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.330574] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.330873] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.331038] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.334051] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.334271] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.334271] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.334471] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.334630] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.342477] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4e234e08-a192-4c7a-badf-3e57629854d7 in Status: IN_PROGRESS for 2s [ 859.343164] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 99194846-a5d9-4dff-8a78-5c66da2ee811 in Status: IN_PROGRESS for 2s [ 859.353317] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.353317] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.353317] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.353317] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.353317] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.353317] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b9d469db-f694-4408-9c06-70ff03328f59 is going to be created. [ 859.364040] env[65306]: INFO networking_nsxv3.common.synchronization [None req-2496c49c-eadd-40d8-8b92-41112ba55fb1 None None] Enqueued Resource ID: fba361d3-9fff-4337-8220-b4e5ec94f047 with Priority: HIGHEST for action port [ 859.364286] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fba361d3-9fff-4337-8220-b4e5ec94f047 with Priority: HIGHEST for action port [ 859.365605] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock port-fba361d3-9fff-4337-8220-b4e5ec94f047 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.365736] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fba361d3-9fff-4337-8220-b4e5ec94f047" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.365806] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fba361d3-9fff-4337-8220-b4e5ec94f047" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.366070] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fba361d3-9fff-4337-8220-b4e5ec94f047" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.366156] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fba361d3-9fff-4337-8220-b4e5ec94f047',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 859.367630] env[65306]: INFO networking_nsxv3.common.synchronization [req-ab91db3a-37cd-42aa-b8ea-3a78c457141c req-c5d83ef5-9a1b-4c97-ba15-96709ced2366 tempest-ListImageFiltersTestJSON-1021467922 tempest-ListImageFiltersTestJSON-1021467922-project-member] Enqueued Resource ID: 0defdd0d-cdbe-4a7c-9871-fd4c40a3847e with Priority: HIGHEST for action security_group_members [ 859.368852] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0defdd0d-cdbe-4a7c-9871-fd4c40a3847e with Priority: HIGHEST for action security_group_members [ 859.369230] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-0defdd0d-cdbe-4a7c-9871-fd4c40a3847e taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.369308] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0defdd0d-cdbe-4a7c-9871-fd4c40a3847e" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.369355] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0defdd0d-cdbe-4a7c-9871-fd4c40a3847e" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.369550] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0defdd0d-cdbe-4a7c-9871-fd4c40a3847e" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.369697] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.369833] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.369910] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.370993] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.371115] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.371219] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0defdd0d-cdbe-4a7c-9871-fd4c40a3847e',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 859.389649] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.389797] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.389870] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.390109] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.390642] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.405877] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b9d469db-f694-4408-9c06-70ff03328f59 in Status: UNINITIALIZED for 2s [ 859.870250] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port fba361d3-9fff-4337-8220-b4e5ec94f047 [ 859.870250] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.870250] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.870250] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.870250] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.870250] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.870250] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:fba361d3-9fff-4337-8220-b4e5ec94f047 already deleted. [ 859.870250] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fba361d3-9fff-4337-8220-b4e5ec94f047" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.876595] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.876595] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.876595] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.876595] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.876595] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.876595] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.876595] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.876595] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.876595] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.876595] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.876595] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0defdd0d-cdbe-4a7c-9871-fd4c40a3847e is going to be updated. [ 859.909292] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.909292] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.909292] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.909292] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.909292] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.955843] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0defdd0d-cdbe-4a7c-9871-fd4c40a3847e in Status: IN_PROGRESS for 2s [ 859.974510] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 56904b3c-38e4-4547-9a1d-cc787c3fef9d in Status: SUCCESS [ 859.974745] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-56904b3c-38e4-4547-9a1d-cc787c3fef9d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.177853] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dbcb04c7-d4cb-4ab9-8312-c80dffeeaa42 in Status: SUCCESS [ 860.178563] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-dbcb04c7-d4cb-4ab9-8312-c80dffeeaa42" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.521735] env[65306]: INFO networking_nsxv3.common.synchronization [None req-801dbbec-293b-4753-8ed6-2370014e2ca6 None None] Enqueued Resource ID: e5cf3759-d3ff-40b2-b419-a176bfa5ac6c with Priority: HIGHEST for action port [ 860.522559] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e5cf3759-d3ff-40b2-b419-a176bfa5ac6c with Priority: HIGHEST for action port [ 860.523045] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock port-e5cf3759-d3ff-40b2-b419-a176bfa5ac6c taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.523224] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e5cf3759-d3ff-40b2-b419-a176bfa5ac6c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.523323] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e5cf3759-d3ff-40b2-b419-a176bfa5ac6c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.523633] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e5cf3759-d3ff-40b2-b419-a176bfa5ac6c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.523925] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e5cf3759-d3ff-40b2-b419-a176bfa5ac6c',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 861.028591] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e5cf3759-d3ff-40b2-b419-a176bfa5ac6c [ 861.028591] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.028591] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.028591] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.028591] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.028591] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.028591] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e5cf3759-d3ff-40b2-b419-a176bfa5ac6c already deleted. [ 861.028591] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e5cf3759-d3ff-40b2-b419-a176bfa5ac6c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.357741] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 99194846-a5d9-4dff-8a78-5c66da2ee811 in Status: SUCCESS [ 861.358473] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-99194846-a5d9-4dff-8a78-5c66da2ee811" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.359920] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4e234e08-a192-4c7a-badf-3e57629854d7 in Status: SUCCESS [ 861.359920] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4e234e08-a192-4c7a-badf-3e57629854d7" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.360224] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-99194846-a5d9-4dff-8a78-5c66da2ee811" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.360710] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-99194846-a5d9-4dff-8a78-5c66da2ee811" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.360980] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.361355] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.361355] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.361355] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.361543] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.361543] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-99194846-a5d9-4dff-8a78-5c66da2ee811" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.361610] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('99194846-a5d9-4dff-8a78-5c66da2ee811',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 861.362427] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4e234e08-a192-4c7a-badf-3e57629854d7" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.362593] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4e234e08-a192-4c7a-badf-3e57629854d7" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.362762] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.362975] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.362975] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.364428] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.364428] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.364428] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4e234e08-a192-4c7a-badf-3e57629854d7" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.364428] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4e234e08-a192-4c7a-badf-3e57629854d7',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 861.419509] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b9d469db-f694-4408-9c06-70ff03328f59 in Status: SUCCESS [ 861.419509] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b9d469db-f694-4408-9c06-70ff03328f59" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.419662] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b9d469db-f694-4408-9c06-70ff03328f59" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.420030] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b9d469db-f694-4408-9c06-70ff03328f59" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.420030] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.420170] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.420206] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.420351] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.420433] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.420925] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b9d469db-f694-4408-9c06-70ff03328f59" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.420925] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b9d469db-f694-4408-9c06-70ff03328f59',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 861.756992] env[65306]: INFO networking_nsxv3.common.synchronization [req-404550c8-1b85-4533-b747-b6b5921224eb req-3839c830-545d-473f-8565-7302fb3b48a8 tempest-ImagesTestJSON-762064805 tempest-ImagesTestJSON-762064805-project-member] Enqueued Resource ID: 57bb6fe9-98c4-47f0-9daa-c424a0c9dfee with Priority: HIGHEST for action security_group_members [ 861.757428] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 57bb6fe9-98c4-47f0-9daa-c424a0c9dfee with Priority: HIGHEST for action security_group_members [ 861.757805] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-57bb6fe9-98c4-47f0-9daa-c424a0c9dfee taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.757930] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-57bb6fe9-98c4-47f0-9daa-c424a0c9dfee" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.757992] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-57bb6fe9-98c4-47f0-9daa-c424a0c9dfee" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.758206] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-57bb6fe9-98c4-47f0-9daa-c424a0c9dfee" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.758366] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.758450] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.758601] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.758667] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.758888] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.758888] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('57bb6fe9-98c4-47f0-9daa-c424a0c9dfee',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 861.867403] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('99194846-a5d9-4dff-8a78-5c66da2ee811',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 861.868696] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-4e234e08-a192-4c7a-badf-3e57629854d7 taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.868855] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4e234e08-a192-4c7a-badf-3e57629854d7" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.868929] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4e234e08-a192-4c7a-badf-3e57629854d7" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.873708] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4e234e08-a192-4c7a-badf-3e57629854d7" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.873708] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.873708] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.873708] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.873708] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.873708] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.873708] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4e234e08-a192-4c7a-badf-3e57629854d7" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.873708] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-4e234e08-a192-4c7a-badf-3e57629854d7 taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.873708] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4e234e08-a192-4c7a-badf-3e57629854d7" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.873708] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4e234e08-a192-4c7a-badf-3e57629854d7" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.873708] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4e234e08-a192-4c7a-badf-3e57629854d7" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.873708] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.874368] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.874368] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.874368] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.874368] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.874368] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4e234e08-a192-4c7a-badf-3e57629854d7" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.874368] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4e234e08-a192-4c7a-badf-3e57629854d7',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 861.924139] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-b9d469db-f694-4408-9c06-70ff03328f59 taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.927019] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b9d469db-f694-4408-9c06-70ff03328f59" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.927019] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b9d469db-f694-4408-9c06-70ff03328f59" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.927019] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b9d469db-f694-4408-9c06-70ff03328f59" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.927019] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.927019] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.927019] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.927019] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.927019] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.927019] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b9d469db-f694-4408-9c06-70ff03328f59" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.927019] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-b9d469db-f694-4408-9c06-70ff03328f59 taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.927019] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b9d469db-f694-4408-9c06-70ff03328f59" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.927019] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b9d469db-f694-4408-9c06-70ff03328f59" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.927019] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b9d469db-f694-4408-9c06-70ff03328f59" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.927019] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.927019] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.927019] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.928156] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.929360] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.929360] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b9d469db-f694-4408-9c06-70ff03328f59" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.929360] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b9d469db-f694-4408-9c06-70ff03328f59',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 861.967489] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0defdd0d-cdbe-4a7c-9871-fd4c40a3847e in Status: SUCCESS [ 861.967659] env[65306]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0defdd0d-cdbe-4a7c-9871-fd4c40a3847e deletion is rescheduled due to dependency. [ 861.967765] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0defdd0d-cdbe-4a7c-9871-fd4c40a3847e" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.209650] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock network-873 taken with stack trace [, , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.210062] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "network-873" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.210062] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "network-873" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.210703] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "network-873" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.210986] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.211163] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.211278] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.211504] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.211662] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.211922] env[65306]: DEBUG dogpile.cache.region [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] No value present for key: 'zone-id' {{(pid=65306) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 862.212069] env[65306]: DEBUG dogpile.lock [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] NeedRegenerationException {{(pid=65306) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 862.212144] env[65306]: DEBUG dogpile.lock [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] no value, waiting for create lock {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 862.212254] env[65306]: DEBUG dogpile.lock [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] value creation lock acquired {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 862.212363] env[65306]: DEBUG dogpile.cache.region [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] No value present for key: 'zone-id' {{(pid=65306) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 862.212466] env[65306]: DEBUG dogpile.lock [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Calling creation function for not-yet-present value {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 862.212598] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 862.235721] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 862.235908] env[65306]: DEBUG dogpile.cache.region [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65306) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 862.236090] env[65306]: DEBUG dogpile.lock [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Released creation lock {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 862.236287] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "network-873" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.236636] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock port-55f1392b-1042-4ea1-82e0-0911f94422ed taken with stack trace [, , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.236820] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "port-55f1392b-1042-4ea1-82e0-0911f94422ed" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.237144] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "port-55f1392b-1042-4ea1-82e0-0911f94422ed" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.239048] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "port-55f1392b-1042-4ea1-82e0-0911f94422ed" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.239231] env[65306]: DEBUG networking_nsxv3.api.rpc [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('55f1392b-1042-4ea1-82e0-0911f94422ed',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 862.263049] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.263284] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.263284] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.263520] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.263614] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.263822] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.263932] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.263995] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.264161] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.264277] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.264335] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 57bb6fe9-98c4-47f0-9daa-c424a0c9dfee is going to be updated. [ 862.293199] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.293384] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.293483] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.294255] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.294255] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.304749] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 57bb6fe9-98c4-47f0-9daa-c424a0c9dfee in Status: IN_PROGRESS for 2s [ 862.376516] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 99194846-a5d9-4dff-8a78-5c66da2ee811: rpc.has_security_group_logging(os_id): False [ 862.377757] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4e234e08-a192-4c7a-badf-3e57629854d7: rpc.has_security_group_logging(os_id): False [ 862.402245] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.402245] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.402245] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.402245] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.402245] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.402245] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.402245] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.402245] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.402245] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.402245] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.402245] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.402245] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.402245] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.402245] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.402245] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.402861] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.402861] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.402861] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.402861] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.402861] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.402861] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4e234e08-a192-4c7a-badf-3e57629854d7 is going to be updated. [ 862.405710] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.405841] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.405887] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.406051] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.406134] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.406328] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.406424] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.407332] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.407332] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.407332] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.407332] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 99194846-a5d9-4dff-8a78-5c66da2ee811 is going to be created. [ 862.431267] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b9d469db-f694-4408-9c06-70ff03328f59: rpc.has_security_group_logging(os_id): False [ 862.462158] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.462343] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.462451] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.462663] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.462797] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.463128] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.463970] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.464201] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.464482] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.464585] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.464881] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.464999] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.465057] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.465192] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.465269] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.465482] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.465579] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.465643] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.465865] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.465865] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.465969] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b9d469db-f694-4408-9c06-70ff03328f59 is going to be created. [ 862.472923] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.473075] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.473129] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.473333] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.473519] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.488241] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.488465] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.488524] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.488861] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.489070] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.498348] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 99194846-a5d9-4dff-8a78-5c66da2ee811 in Status: IN_PROGRESS for 2s [ 862.515506] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4e234e08-a192-4c7a-badf-3e57629854d7 in Status: IN_PROGRESS for 2s [ 862.569490] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.569704] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.569704] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.570049] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.570049] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.601208] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b9d469db-f694-4408-9c06-70ff03328f59 in Status: IN_PROGRESS for 2s [ 862.745206] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.745527] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.745676] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.746055] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.746302] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.746547] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Segment Port 55f1392b-1042-4ea1-82e0-0911f94422ed not found, creating... [ 862.746966] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.747251] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.747452] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.747822] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.747943] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.748284] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.748472] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.748800] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.748800] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.748800] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.749019] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Resource: SegmentPort with ID: 55f1392b-1042-4ea1-82e0-0911f94422ed is going to be created. [ 862.771883] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.772115] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.772267] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.772531] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.772753] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.772990] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "port-55f1392b-1042-4ea1-82e0-0911f94422ed" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.044656] env[65306]: INFO networking_nsxv3.common.synchronization [None req-9315bbed-2822-4baa-8178-6904183393de None None] Enqueued Resource ID: 35e9a76f-bf31-4c43-9ba1-703816fde98f with Priority: HIGHEST for action port [ 863.045660] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 35e9a76f-bf31-4c43-9ba1-703816fde98f with Priority: HIGHEST for action port [ 863.046350] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock port-35e9a76f-bf31-4c43-9ba1-703816fde98f taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.046572] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-35e9a76f-bf31-4c43-9ba1-703816fde98f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.046572] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-35e9a76f-bf31-4c43-9ba1-703816fde98f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.048296] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-35e9a76f-bf31-4c43-9ba1-703816fde98f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.048296] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('35e9a76f-bf31-4c43-9ba1-703816fde98f',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 863.473105] env[65306]: INFO networking_nsxv3.common.synchronization [req-404550c8-1b85-4533-b747-b6b5921224eb req-afe5bb6b-7248-4e55-bf8b-f3d5bf933ea2 service nova] Enqueued Resource ID: 57bb6fe9-98c4-47f0-9daa-c424a0c9dfee with Priority: HIGHEST for action security_group_rules [ 863.473407] env[65306]: INFO networking_nsxv3.common.synchronization [req-404550c8-1b85-4533-b747-b6b5921224eb req-afe5bb6b-7248-4e55-bf8b-f3d5bf933ea2 service nova] Enqueued Resource ID: 57bb6fe9-98c4-47f0-9daa-c424a0c9dfee with Priority: HIGHEST for action security_group_members [ 863.473657] env[65306]: INFO networking_nsxv3.common.synchronization [req-404550c8-1b85-4533-b747-b6b5921224eb req-afe5bb6b-7248-4e55-bf8b-f3d5bf933ea2 service nova] Enqueued Resource ID: 55f1392b-1042-4ea1-82e0-0911f94422ed with Priority: HIGHEST for action port [ 863.476222] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 57bb6fe9-98c4-47f0-9daa-c424a0c9dfee with Priority: HIGHEST for action security_group_rules [ 863.476731] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 57bb6fe9-98c4-47f0-9daa-c424a0c9dfee with Priority: HIGHEST for action security_group_members [ 863.477403] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 55f1392b-1042-4ea1-82e0-0911f94422ed with Priority: HIGHEST for action port [ 863.477827] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock rules-57bb6fe9-98c4-47f0-9daa-c424a0c9dfee taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.481037] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-57bb6fe9-98c4-47f0-9daa-c424a0c9dfee" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.481037] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-57bb6fe9-98c4-47f0-9daa-c424a0c9dfee" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.481037] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-57bb6fe9-98c4-47f0-9daa-c424a0c9dfee" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.481037] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('57bb6fe9-98c4-47f0-9daa-c424a0c9dfee',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 863.481037] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-57bb6fe9-98c4-47f0-9daa-c424a0c9dfee taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.481037] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-57bb6fe9-98c4-47f0-9daa-c424a0c9dfee" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.481308] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock port-55f1392b-1042-4ea1-82e0-0911f94422ed taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.481308] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-55f1392b-1042-4ea1-82e0-0911f94422ed" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.481308] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-55f1392b-1042-4ea1-82e0-0911f94422ed" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.481457] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-55f1392b-1042-4ea1-82e0-0911f94422ed" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.481844] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('55f1392b-1042-4ea1-82e0-0911f94422ed',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 863.553239] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 35e9a76f-bf31-4c43-9ba1-703816fde98f [ 863.553493] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.553632] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.553703] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.553925] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.554028] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.554138] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:35e9a76f-bf31-4c43-9ba1-703816fde98f already deleted. [ 863.554222] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-35e9a76f-bf31-4c43-9ba1-703816fde98f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.983716] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-57bb6fe9-98c4-47f0-9daa-c424a0c9dfee taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.984254] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-57bb6fe9-98c4-47f0-9daa-c424a0c9dfee" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.984254] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 55f1392b-1042-4ea1-82e0-0911f94422ed with status ACTIVE [ 863.984411] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.985286] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.985286] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.985286] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.985286] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.985286] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.985286] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.985286] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.985695] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.985695] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.985695] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.985807] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.985807] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.985969] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.986073] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.986164] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 55f1392b-1042-4ea1-82e0-0911f94422ed is going to be updated. [ 864.009773] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.009930] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.010009] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.010225] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.010365] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.010533] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-55f1392b-1042-4ea1-82e0-0911f94422ed" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.325742] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 57bb6fe9-98c4-47f0-9daa-c424a0c9dfee in Status: SUCCESS [ 864.326244] env[65306]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 57bb6fe9-98c4-47f0-9daa-c424a0c9dfee deletion is rescheduled due to dependency. [ 864.326510] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-57bb6fe9-98c4-47f0-9daa-c424a0c9dfee" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.326853] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-57bb6fe9-98c4-47f0-9daa-c424a0c9dfee" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.327298] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-57bb6fe9-98c4-47f0-9daa-c424a0c9dfee" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.327742] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.329034] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.329128] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.329424] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.329626] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.329847] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('57bb6fe9-98c4-47f0-9daa-c424a0c9dfee',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 864.516753] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 99194846-a5d9-4dff-8a78-5c66da2ee811 in Status: SUCCESS [ 864.517201] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-99194846-a5d9-4dff-8a78-5c66da2ee811" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.533289] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4e234e08-a192-4c7a-badf-3e57629854d7 in Status: SUCCESS [ 864.533530] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4e234e08-a192-4c7a-badf-3e57629854d7" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.623739] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b9d469db-f694-4408-9c06-70ff03328f59 in Status: SUCCESS [ 864.624307] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b9d469db-f694-4408-9c06-70ff03328f59" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.835534] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('57bb6fe9-98c4-47f0-9daa-c424a0c9dfee',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 865.338122] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('57bb6fe9-98c4-47f0-9daa-c424a0c9dfee',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 865.841248] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.841554] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.841639] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.842330] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.843714] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.843714] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 57bb6fe9-98c4-47f0-9daa-c424a0c9dfee is going to be updated. [ 865.878753] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.878935] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.879011] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.880322] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.880448] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.891964] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 57bb6fe9-98c4-47f0-9daa-c424a0c9dfee in Status: IN_PROGRESS for 2s [ 866.735294] env[65306]: INFO networking_nsxv3.common.synchronization [req-d7e55b1f-f4ee-4aa7-8b63-23f9c1d3f1da req-ea7698fa-9077-46b9-ac23-1b6674df7cea tempest-ServerDiskConfigTestJSON-771154958 tempest-ServerDiskConfigTestJSON-771154958-project-member] Enqueued Resource ID: 9e80329d-1fcd-4c50-8991-a90e2a1fbdbc with Priority: HIGHEST for action security_group_members [ 866.735970] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9e80329d-1fcd-4c50-8991-a90e2a1fbdbc with Priority: HIGHEST for action security_group_members [ 866.736300] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-9e80329d-1fcd-4c50-8991-a90e2a1fbdbc taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.736463] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9e80329d-1fcd-4c50-8991-a90e2a1fbdbc" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.736542] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9e80329d-1fcd-4c50-8991-a90e2a1fbdbc" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.736750] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9e80329d-1fcd-4c50-8991-a90e2a1fbdbc" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.736913] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.737017] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.737101] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.737263] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.737368] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.737466] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9e80329d-1fcd-4c50-8991-a90e2a1fbdbc',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 867.220667] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock network-681 taken with stack trace [, , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.221011] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "network-681" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.221167] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "network-681" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.221445] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "network-681" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.221706] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.221881] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.221998] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.222408] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.222600] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.222737] env[65306]: DEBUG dogpile.cache.region [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] No value present for key: 'zone-id' {{(pid=65306) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 867.222849] env[65306]: DEBUG dogpile.lock [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] NeedRegenerationException {{(pid=65306) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 867.222988] env[65306]: DEBUG dogpile.lock [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] no value, waiting for create lock {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 867.223120] env[65306]: DEBUG dogpile.lock [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] value creation lock acquired {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 867.223321] env[65306]: DEBUG dogpile.cache.region [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] No value present for key: 'zone-id' {{(pid=65306) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 867.223437] env[65306]: DEBUG dogpile.lock [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Calling creation function for not-yet-present value {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 867.223576] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 867.240125] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.240343] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.240343] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.240570] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.240732] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.240910] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.241045] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.241111] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.241238] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.241317] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.241407] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9e80329d-1fcd-4c50-8991-a90e2a1fbdbc is going to be updated. [ 867.245237] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 867.245401] env[65306]: DEBUG dogpile.cache.region [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65306) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 867.245561] env[65306]: DEBUG dogpile.lock [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Released creation lock {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 867.245709] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "network-681" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.246388] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock port-18fb4ec1-0f47-42f8-b8d6-5c29571fd498 taken with stack trace [, , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.246388] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "port-18fb4ec1-0f47-42f8-b8d6-5c29571fd498" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.246388] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "port-18fb4ec1-0f47-42f8-b8d6-5c29571fd498" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.246718] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "port-18fb4ec1-0f47-42f8-b8d6-5c29571fd498" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.246829] env[65306]: DEBUG networking_nsxv3.api.rpc [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('18fb4ec1-0f47-42f8-b8d6-5c29571fd498',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 867.276332] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.276577] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.276667] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.277059] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.277059] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.289545] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9e80329d-1fcd-4c50-8991-a90e2a1fbdbc in Status: IN_PROGRESS for 2s [ 867.749366] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.749658] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.749764] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.750030] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.751767] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.751767] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Segment Port 18fb4ec1-0f47-42f8-b8d6-5c29571fd498 not found, creating... [ 867.751767] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.751767] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.751767] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.751767] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.752057] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.752171] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.752331] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.752448] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.752666] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.752898] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.752970] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Resource: SegmentPort with ID: 18fb4ec1-0f47-42f8-b8d6-5c29571fd498 is going to be created. [ 867.778235] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.778601] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.778969] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.779452] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.779855] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.780174] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "port-18fb4ec1-0f47-42f8-b8d6-5c29571fd498" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.856252] env[65306]: INFO networking_nsxv3.common.synchronization [None req-d2d723b5-bd3f-4572-af86-7e6aa723fe03 None None] Enqueued Resource ID: 4ffa6cd1-2a2b-4dc3-95e0-641cd9d6f408 with Priority: HIGHEST for action port [ 867.856252] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4ffa6cd1-2a2b-4dc3-95e0-641cd9d6f408 with Priority: HIGHEST for action port [ 867.856252] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock port-4ffa6cd1-2a2b-4dc3-95e0-641cd9d6f408 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.856252] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4ffa6cd1-2a2b-4dc3-95e0-641cd9d6f408" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.856252] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4ffa6cd1-2a2b-4dc3-95e0-641cd9d6f408" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.856252] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4ffa6cd1-2a2b-4dc3-95e0-641cd9d6f408" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.856849] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4ffa6cd1-2a2b-4dc3-95e0-641cd9d6f408',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 867.905235] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 57bb6fe9-98c4-47f0-9daa-c424a0c9dfee in Status: SUCCESS [ 867.905235] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-57bb6fe9-98c4-47f0-9daa-c424a0c9dfee" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.905235] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-57bb6fe9-98c4-47f0-9daa-c424a0c9dfee" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.905235] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-57bb6fe9-98c4-47f0-9daa-c424a0c9dfee" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.905235] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.905235] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.905235] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.905235] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.905235] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.905235] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-57bb6fe9-98c4-47f0-9daa-c424a0c9dfee" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.905235] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('57bb6fe9-98c4-47f0-9daa-c424a0c9dfee',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 868.359973] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4ffa6cd1-2a2b-4dc3-95e0-641cd9d6f408 [ 868.360408] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.361248] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.361248] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.361630] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.361630] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.361630] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4ffa6cd1-2a2b-4dc3-95e0-641cd9d6f408 already deleted. [ 868.361809] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4ffa6cd1-2a2b-4dc3-95e0-641cd9d6f408" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.407643] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-57bb6fe9-98c4-47f0-9daa-c424a0c9dfee taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.407802] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-57bb6fe9-98c4-47f0-9daa-c424a0c9dfee" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.407802] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-57bb6fe9-98c4-47f0-9daa-c424a0c9dfee" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.409862] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-57bb6fe9-98c4-47f0-9daa-c424a0c9dfee" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.409862] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.409862] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.409862] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.409862] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.409862] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.409862] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-57bb6fe9-98c4-47f0-9daa-c424a0c9dfee" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.409862] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-57bb6fe9-98c4-47f0-9daa-c424a0c9dfee taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.409862] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-57bb6fe9-98c4-47f0-9daa-c424a0c9dfee" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.409862] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-57bb6fe9-98c4-47f0-9daa-c424a0c9dfee" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.409862] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-57bb6fe9-98c4-47f0-9daa-c424a0c9dfee" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.409862] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.409862] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.409862] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.409862] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.409862] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.409862] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-57bb6fe9-98c4-47f0-9daa-c424a0c9dfee" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.409862] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('57bb6fe9-98c4-47f0-9daa-c424a0c9dfee',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 868.560079] env[65306]: INFO networking_nsxv3.common.synchronization [req-d7e55b1f-f4ee-4aa7-8b63-23f9c1d3f1da req-8274ede7-1062-4a98-9f14-987db44a2f14 service nova] Enqueued Resource ID: 9e80329d-1fcd-4c50-8991-a90e2a1fbdbc with Priority: HIGHEST for action security_group_rules [ 868.560079] env[65306]: INFO networking_nsxv3.common.synchronization [req-d7e55b1f-f4ee-4aa7-8b63-23f9c1d3f1da req-8274ede7-1062-4a98-9f14-987db44a2f14 service nova] Enqueued Resource ID: 9e80329d-1fcd-4c50-8991-a90e2a1fbdbc with Priority: HIGHEST for action security_group_members [ 868.560079] env[65306]: INFO networking_nsxv3.common.synchronization [req-d7e55b1f-f4ee-4aa7-8b63-23f9c1d3f1da req-8274ede7-1062-4a98-9f14-987db44a2f14 service nova] Enqueued Resource ID: 18fb4ec1-0f47-42f8-b8d6-5c29571fd498 with Priority: HIGHEST for action port [ 868.560595] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9e80329d-1fcd-4c50-8991-a90e2a1fbdbc with Priority: HIGHEST for action security_group_rules [ 868.560776] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9e80329d-1fcd-4c50-8991-a90e2a1fbdbc with Priority: HIGHEST for action security_group_members [ 868.561577] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 18fb4ec1-0f47-42f8-b8d6-5c29571fd498 with Priority: HIGHEST for action port [ 868.565592] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9e80329d-1fcd-4c50-8991-a90e2a1fbdbc taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.565732] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9e80329d-1fcd-4c50-8991-a90e2a1fbdbc" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.565806] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9e80329d-1fcd-4c50-8991-a90e2a1fbdbc" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.566032] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9e80329d-1fcd-4c50-8991-a90e2a1fbdbc" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.566140] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9e80329d-1fcd-4c50-8991-a90e2a1fbdbc',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 868.567048] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-9e80329d-1fcd-4c50-8991-a90e2a1fbdbc taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.567360] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9e80329d-1fcd-4c50-8991-a90e2a1fbdbc" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.567360] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock port-18fb4ec1-0f47-42f8-b8d6-5c29571fd498 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.568300] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-18fb4ec1-0f47-42f8-b8d6-5c29571fd498" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.568300] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-18fb4ec1-0f47-42f8-b8d6-5c29571fd498" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.568300] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-18fb4ec1-0f47-42f8-b8d6-5c29571fd498" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.568300] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('18fb4ec1-0f47-42f8-b8d6-5c29571fd498',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 868.913536] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 57bb6fe9-98c4-47f0-9daa-c424a0c9dfee: rpc.has_security_group_logging(os_id): False [ 868.936375] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.936375] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.936709] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.936709] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.936709] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.937023] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.937123] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.937123] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.937814] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.937814] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.937814] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.937814] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.937814] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.938066] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.939449] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.939614] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.939709] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.939792] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.939967] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.940090] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.940170] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 57bb6fe9-98c4-47f0-9daa-c424a0c9dfee is going to be updated. [ 869.016674] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.016916] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.017029] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.017256] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.017408] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.033859] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 57bb6fe9-98c4-47f0-9daa-c424a0c9dfee in Status: IN_PROGRESS for 2s [ 869.071727] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-9e80329d-1fcd-4c50-8991-a90e2a1fbdbc taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.071995] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9e80329d-1fcd-4c50-8991-a90e2a1fbdbc" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.072890] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 18fb4ec1-0f47-42f8-b8d6-5c29571fd498 with status ACTIVE [ 869.073435] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.073784] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.073881] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.074140] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.074234] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.074455] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.074643] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.074643] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.074774] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.074861] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.075088] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.075172] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.075213] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.075376] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.075462] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.075547] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 18fb4ec1-0f47-42f8-b8d6-5c29571fd498 is going to be updated. [ 869.104387] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.104615] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.104615] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.104800] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.108704] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.108704] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-18fb4ec1-0f47-42f8-b8d6-5c29571fd498" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.287979] env[65306]: INFO networking_nsxv3.common.synchronization [req-39d06d00-c7a0-436f-a45d-bf6eb58ab2be req-1626ab4d-435f-46f9-95ae-116c9490469a tempest-ServersTestJSON-1773114292 tempest-ServersTestJSON-1773114292-project-member] Enqueued Resource ID: 0cb41b0f-cdd2-4222-95b4-bafd614b7460 with Priority: HIGHEST for action security_group_members [ 869.288624] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0cb41b0f-cdd2-4222-95b4-bafd614b7460 with Priority: HIGHEST for action security_group_members [ 869.288989] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-0cb41b0f-cdd2-4222-95b4-bafd614b7460 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.289128] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0cb41b0f-cdd2-4222-95b4-bafd614b7460" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.289196] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0cb41b0f-cdd2-4222-95b4-bafd614b7460" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.289495] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0cb41b0f-cdd2-4222-95b4-bafd614b7460" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.289682] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.289795] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.289867] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.290045] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.290145] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.290253] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0cb41b0f-cdd2-4222-95b4-bafd614b7460',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 869.302253] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9e80329d-1fcd-4c50-8991-a90e2a1fbdbc in Status: SUCCESS [ 869.302455] env[65306]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9e80329d-1fcd-4c50-8991-a90e2a1fbdbc deletion is rescheduled due to dependency. [ 869.302805] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9e80329d-1fcd-4c50-8991-a90e2a1fbdbc" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.302805] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9e80329d-1fcd-4c50-8991-a90e2a1fbdbc" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.303144] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9e80329d-1fcd-4c50-8991-a90e2a1fbdbc" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.303469] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.303469] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.303469] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.303678] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.303678] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.303832] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9e80329d-1fcd-4c50-8991-a90e2a1fbdbc',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 869.684976] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock network-949 taken with stack trace [, , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.685301] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "network-949" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.685301] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "network-949" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.685988] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "network-949" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.685988] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.685988] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.686541] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.687934] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.688876] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.689400] env[65306]: DEBUG dogpile.cache.region [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] No value present for key: 'zone-id' {{(pid=65306) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 869.689671] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] NeedRegenerationException {{(pid=65306) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 869.689671] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] no value, waiting for create lock {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 869.689671] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] value creation lock acquired {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 869.689785] env[65306]: DEBUG dogpile.cache.region [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] No value present for key: 'zone-id' {{(pid=65306) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 869.690122] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Calling creation function for not-yet-present value {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 869.690122] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 869.712526] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 869.712812] env[65306]: DEBUG dogpile.cache.region [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65306) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 869.712950] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Released creation lock {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 869.713203] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "network-949" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.713612] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock port-f202fb87-0a3d-40ee-8a96-0d8c49a1815c taken with stack trace [, , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.713837] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "port-f202fb87-0a3d-40ee-8a96-0d8c49a1815c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.714041] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "port-f202fb87-0a3d-40ee-8a96-0d8c49a1815c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.714498] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "port-f202fb87-0a3d-40ee-8a96-0d8c49a1815c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.714632] env[65306]: DEBUG networking_nsxv3.api.rpc [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f202fb87-0a3d-40ee-8a96-0d8c49a1815c',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 869.793795] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.793795] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.793795] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.794156] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.794156] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.794487] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.794487] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.794487] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.795370] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.795920] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.795920] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0cb41b0f-cdd2-4222-95b4-bafd614b7460 already deleted. [ 869.795920] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0cb41b0f-cdd2-4222-95b4-bafd614b7460" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.808999] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9e80329d-1fcd-4c50-8991-a90e2a1fbdbc',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 870.217811] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.219246] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.219246] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.219246] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.219246] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.219246] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Segment Port f202fb87-0a3d-40ee-8a96-0d8c49a1815c not found, creating... [ 870.219246] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.219246] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.219591] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.219628] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.219938] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.220026] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.220180] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.220293] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.220495] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.220624] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.220788] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Resource: SegmentPort with ID: f202fb87-0a3d-40ee-8a96-0d8c49a1815c is going to be created. [ 870.243249] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.243468] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.243687] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.243929] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.244194] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.244432] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "port-f202fb87-0a3d-40ee-8a96-0d8c49a1815c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.311353] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9e80329d-1fcd-4c50-8991-a90e2a1fbdbc',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 870.448385] env[65306]: INFO networking_nsxv3.common.synchronization [None req-47897436-1ad0-4781-afdd-5b313ac191d2 None None] Enqueued Resource ID: e2157df9-6af9-4ac0-8625-c01320d18ffb with Priority: HIGHEST for action port [ 870.449095] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e2157df9-6af9-4ac0-8625-c01320d18ffb with Priority: HIGHEST for action port [ 870.449487] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock port-e2157df9-6af9-4ac0-8625-c01320d18ffb taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.450063] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e2157df9-6af9-4ac0-8625-c01320d18ffb" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.450063] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e2157df9-6af9-4ac0-8625-c01320d18ffb" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.450063] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e2157df9-6af9-4ac0-8625-c01320d18ffb" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.450589] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e2157df9-6af9-4ac0-8625-c01320d18ffb',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 870.814643] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.814977] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.814977] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.815183] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.815274] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.815380] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9e80329d-1fcd-4c50-8991-a90e2a1fbdbc is going to be updated. [ 870.866020] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.866020] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.866020] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.866020] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.866020] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.876428] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9e80329d-1fcd-4c50-8991-a90e2a1fbdbc in Status: IN_PROGRESS for 2s [ 870.955044] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e2157df9-6af9-4ac0-8625-c01320d18ffb [ 870.955044] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.955044] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.955044] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.955044] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.955044] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.955044] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e2157df9-6af9-4ac0-8625-c01320d18ffb already deleted. [ 870.955044] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e2157df9-6af9-4ac0-8625-c01320d18ffb" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.055132] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 57bb6fe9-98c4-47f0-9daa-c424a0c9dfee in Status: SUCCESS [ 871.055359] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-57bb6fe9-98c4-47f0-9daa-c424a0c9dfee" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.097422] env[65306]: INFO networking_nsxv3.common.synchronization [req-39d06d00-c7a0-436f-a45d-bf6eb58ab2be req-cb63f9e1-b259-4063-8594-e60e0fe37221 service nova] Enqueued Resource ID: 0cb41b0f-cdd2-4222-95b4-bafd614b7460 with Priority: HIGHEST for action security_group_rules [ 871.097422] env[65306]: INFO networking_nsxv3.common.synchronization [req-39d06d00-c7a0-436f-a45d-bf6eb58ab2be req-cb63f9e1-b259-4063-8594-e60e0fe37221 service nova] Enqueued Resource ID: 0cb41b0f-cdd2-4222-95b4-bafd614b7460 with Priority: HIGHEST for action security_group_members [ 871.097422] env[65306]: INFO networking_nsxv3.common.synchronization [req-39d06d00-c7a0-436f-a45d-bf6eb58ab2be req-cb63f9e1-b259-4063-8594-e60e0fe37221 service nova] Enqueued Resource ID: f202fb87-0a3d-40ee-8a96-0d8c49a1815c with Priority: HIGHEST for action port [ 871.097422] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0cb41b0f-cdd2-4222-95b4-bafd614b7460 with Priority: HIGHEST for action security_group_rules [ 871.097422] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0cb41b0f-cdd2-4222-95b4-bafd614b7460 with Priority: HIGHEST for action security_group_members [ 871.097422] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f202fb87-0a3d-40ee-8a96-0d8c49a1815c with Priority: HIGHEST for action port [ 871.097422] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0cb41b0f-cdd2-4222-95b4-bafd614b7460 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.097422] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0cb41b0f-cdd2-4222-95b4-bafd614b7460" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.097422] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0cb41b0f-cdd2-4222-95b4-bafd614b7460" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.097422] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0cb41b0f-cdd2-4222-95b4-bafd614b7460" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.097858] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0cb41b0f-cdd2-4222-95b4-bafd614b7460',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 871.099141] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-0cb41b0f-cdd2-4222-95b4-bafd614b7460 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.099282] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0cb41b0f-cdd2-4222-95b4-bafd614b7460" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.099282] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0cb41b0f-cdd2-4222-95b4-bafd614b7460" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.099462] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0cb41b0f-cdd2-4222-95b4-bafd614b7460" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.099613] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.099808] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.099898] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.100070] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.100165] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.100251] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0cb41b0f-cdd2-4222-95b4-bafd614b7460',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 871.103314] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock port-f202fb87-0a3d-40ee-8a96-0d8c49a1815c taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.103430] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f202fb87-0a3d-40ee-8a96-0d8c49a1815c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.103498] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f202fb87-0a3d-40ee-8a96-0d8c49a1815c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.103678] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f202fb87-0a3d-40ee-8a96-0d8c49a1815c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.103756] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f202fb87-0a3d-40ee-8a96-0d8c49a1815c',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 871.600355] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-0cb41b0f-cdd2-4222-95b4-bafd614b7460 taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.600531] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0cb41b0f-cdd2-4222-95b4-bafd614b7460" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.603980] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0cb41b0f-cdd2-4222-95b4-bafd614b7460',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 871.610350] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f202fb87-0a3d-40ee-8a96-0d8c49a1815c with status ACTIVE [ 871.610584] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.610743] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.610847] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.611157] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.611310] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.611579] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.611727] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.611820] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.612076] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.612195] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.612936] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.612936] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.612936] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.612936] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.614531] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.614531] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f202fb87-0a3d-40ee-8a96-0d8c49a1815c is going to be updated. [ 871.648355] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.648552] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.648552] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.648806] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.649245] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.649245] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f202fb87-0a3d-40ee-8a96-0d8c49a1815c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.106801] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0cb41b0f-cdd2-4222-95b4-bafd614b7460',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 872.490637] env[65306]: INFO networking_nsxv3.common.synchronization [req-0d2421b4-0687-48ca-8f5b-5daee0eeeade req-25e3133d-2be1-4c42-9732-f0022c078c81 tempest-ServerDiagnosticsNegativeTest-493131972 tempest-ServerDiagnosticsNegativeTest-493131972-project-member] Enqueued Resource ID: dbcb04c7-d4cb-4ab9-8312-c80dffeeaa42 with Priority: HIGHEST for action security_group_members [ 872.491277] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dbcb04c7-d4cb-4ab9-8312-c80dffeeaa42 with Priority: HIGHEST for action security_group_members [ 872.491620] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-dbcb04c7-d4cb-4ab9-8312-c80dffeeaa42 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.491752] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dbcb04c7-d4cb-4ab9-8312-c80dffeeaa42" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.492047] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dbcb04c7-d4cb-4ab9-8312-c80dffeeaa42" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.492232] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dbcb04c7-d4cb-4ab9-8312-c80dffeeaa42" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.492402] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.492504] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.492583] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.492765] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.492994] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.493109] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dbcb04c7-d4cb-4ab9-8312-c80dffeeaa42',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 872.500282] env[65306]: INFO networking_nsxv3.common.synchronization [req-68c317d5-b7ac-49b1-bfa3-f6a267e5afd1 req-e0afb481-2689-4506-82b9-0dae5563ed58 tempest-ServersTestBootFromVolume-1537688806 tempest-ServersTestBootFromVolume-1537688806-project-member] Enqueued Resource ID: c3ffb1bc-84c3-4121-a677-8d413e70c9cc with Priority: HIGHEST for action security_group_members [ 872.500774] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c3ffb1bc-84c3-4121-a677-8d413e70c9cc with Priority: HIGHEST for action security_group_members [ 872.501081] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-c3ffb1bc-84c3-4121-a677-8d413e70c9cc taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.501198] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c3ffb1bc-84c3-4121-a677-8d413e70c9cc" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.501265] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c3ffb1bc-84c3-4121-a677-8d413e70c9cc" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.501449] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c3ffb1bc-84c3-4121-a677-8d413e70c9cc" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.501594] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.501771] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.501875] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.502091] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.502186] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.502282] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c3ffb1bc-84c3-4121-a677-8d413e70c9cc',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 872.611982] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.611982] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.611982] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.611982] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.611982] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.611982] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0cb41b0f-cdd2-4222-95b4-bafd614b7460 is going to be created. [ 872.642332] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.642898] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.642898] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.642898] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.642898] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.656965] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0cb41b0f-cdd2-4222-95b4-bafd614b7460 in Status: UNINITIALIZED for 2s [ 872.894840] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9e80329d-1fcd-4c50-8991-a90e2a1fbdbc in Status: SUCCESS [ 872.894840] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9e80329d-1fcd-4c50-8991-a90e2a1fbdbc" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.894840] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9e80329d-1fcd-4c50-8991-a90e2a1fbdbc" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.894840] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9e80329d-1fcd-4c50-8991-a90e2a1fbdbc" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.894840] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.894840] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.894840] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.894840] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.894840] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.894840] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9e80329d-1fcd-4c50-8991-a90e2a1fbdbc" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.894840] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9e80329d-1fcd-4c50-8991-a90e2a1fbdbc',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 872.995477] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.995656] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.995745] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.996223] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.996316] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.996526] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.996629] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.996687] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.996847] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.996922] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.997016] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dbcb04c7-d4cb-4ab9-8312-c80dffeeaa42 is going to be updated. [ 873.006467] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.006671] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.006721] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.006929] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.007313] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.007385] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.007510] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.007586] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.007832] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.007962] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.008100] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c3ffb1bc-84c3-4121-a677-8d413e70c9cc is going to be updated. [ 873.033773] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.034079] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.034079] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.034592] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.034592] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.037360] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.037360] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.037360] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.037360] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.037360] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.049340] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c3ffb1bc-84c3-4121-a677-8d413e70c9cc in Status: IN_PROGRESS for 2s [ 873.050089] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dbcb04c7-d4cb-4ab9-8312-c80dffeeaa42 in Status: IN_PROGRESS for 2s [ 873.067023] env[65306]: INFO networking_nsxv3.common.synchronization [req-04df3d18-e3c6-4cba-bbcf-48d5cc19840b req-c055a5b0-da80-4967-b8b8-6f34aeb56e09 tempest-SecurityGroupsTestJSON-960025904 tempest-SecurityGroupsTestJSON-960025904-project-member] Enqueued Resource ID: 99194846-a5d9-4dff-8a78-5c66da2ee811 with Priority: HIGHEST for action security_group_members [ 873.067023] env[65306]: INFO networking_nsxv3.common.synchronization [req-04df3d18-e3c6-4cba-bbcf-48d5cc19840b req-c055a5b0-da80-4967-b8b8-6f34aeb56e09 tempest-SecurityGroupsTestJSON-960025904 tempest-SecurityGroupsTestJSON-960025904-project-member] Enqueued Resource ID: 4e234e08-a192-4c7a-badf-3e57629854d7 with Priority: HIGHEST for action security_group_members [ 873.067023] env[65306]: INFO networking_nsxv3.common.synchronization [req-04df3d18-e3c6-4cba-bbcf-48d5cc19840b req-c055a5b0-da80-4967-b8b8-6f34aeb56e09 tempest-SecurityGroupsTestJSON-960025904 tempest-SecurityGroupsTestJSON-960025904-project-member] Enqueued Resource ID: cbfc1dea-3e2d-4303-95a0-e82a6c64f3c7 with Priority: HIGHEST for action security_group_members [ 873.067023] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 99194846-a5d9-4dff-8a78-5c66da2ee811 with Priority: HIGHEST for action security_group_members [ 873.067023] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4e234e08-a192-4c7a-badf-3e57629854d7 with Priority: HIGHEST for action security_group_members [ 873.067023] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cbfc1dea-3e2d-4303-95a0-e82a6c64f3c7 with Priority: HIGHEST for action security_group_members [ 873.068198] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-99194846-a5d9-4dff-8a78-5c66da2ee811 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.068198] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-99194846-a5d9-4dff-8a78-5c66da2ee811" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.068198] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-99194846-a5d9-4dff-8a78-5c66da2ee811" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.068458] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-99194846-a5d9-4dff-8a78-5c66da2ee811" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.068628] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.068732] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.068792] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.071417] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.071417] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.071417] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('99194846-a5d9-4dff-8a78-5c66da2ee811',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 873.071417] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-4e234e08-a192-4c7a-badf-3e57629854d7 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.071417] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4e234e08-a192-4c7a-badf-3e57629854d7" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.071417] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4e234e08-a192-4c7a-badf-3e57629854d7" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.071869] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4e234e08-a192-4c7a-badf-3e57629854d7" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.071869] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.071869] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.071869] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.072124] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.072124] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.072229] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4e234e08-a192-4c7a-badf-3e57629854d7',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 873.073867] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-cbfc1dea-3e2d-4303-95a0-e82a6c64f3c7 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.073986] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cbfc1dea-3e2d-4303-95a0-e82a6c64f3c7" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.073986] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cbfc1dea-3e2d-4303-95a0-e82a6c64f3c7" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.075329] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cbfc1dea-3e2d-4303-95a0-e82a6c64f3c7" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.075329] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.075329] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.075329] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.075329] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.075329] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.075329] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cbfc1dea-3e2d-4303-95a0-e82a6c64f3c7',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 873.160672] env[65306]: INFO networking_nsxv3.common.synchronization [req-04df3d18-e3c6-4cba-bbcf-48d5cc19840b req-c055a5b0-da80-4967-b8b8-6f34aeb56e09 tempest-SecurityGroupsTestJSON-960025904 tempest-SecurityGroupsTestJSON-960025904-project-member] Enqueued Resource ID: 4e234e08-a192-4c7a-badf-3e57629854d7 with Priority: HIGHEST for action security_group_rules [ 873.161222] env[65306]: INFO networking_nsxv3.common.synchronization [req-04df3d18-e3c6-4cba-bbcf-48d5cc19840b req-c055a5b0-da80-4967-b8b8-6f34aeb56e09 tempest-SecurityGroupsTestJSON-960025904 tempest-SecurityGroupsTestJSON-960025904-project-member] Enqueued Resource ID: 4e234e08-a192-4c7a-badf-3e57629854d7 with Priority: HIGHEST for action security_group_members [ 873.161435] env[65306]: INFO networking_nsxv3.common.synchronization [req-04df3d18-e3c6-4cba-bbcf-48d5cc19840b req-c055a5b0-da80-4967-b8b8-6f34aeb56e09 tempest-SecurityGroupsTestJSON-960025904 tempest-SecurityGroupsTestJSON-960025904-project-member] Enqueued Resource ID: 99194846-a5d9-4dff-8a78-5c66da2ee811 with Priority: HIGHEST for action security_group_rules [ 873.161578] env[65306]: INFO networking_nsxv3.common.synchronization [req-04df3d18-e3c6-4cba-bbcf-48d5cc19840b req-c055a5b0-da80-4967-b8b8-6f34aeb56e09 tempest-SecurityGroupsTestJSON-960025904 tempest-SecurityGroupsTestJSON-960025904-project-member] Enqueued Resource ID: 99194846-a5d9-4dff-8a78-5c66da2ee811 with Priority: HIGHEST for action security_group_members [ 873.161713] env[65306]: INFO networking_nsxv3.common.synchronization [req-04df3d18-e3c6-4cba-bbcf-48d5cc19840b req-c055a5b0-da80-4967-b8b8-6f34aeb56e09 tempest-SecurityGroupsTestJSON-960025904 tempest-SecurityGroupsTestJSON-960025904-project-member] Enqueued Resource ID: cbfc1dea-3e2d-4303-95a0-e82a6c64f3c7 with Priority: HIGHEST for action security_group_rules [ 873.161872] env[65306]: INFO networking_nsxv3.common.synchronization [req-04df3d18-e3c6-4cba-bbcf-48d5cc19840b req-c055a5b0-da80-4967-b8b8-6f34aeb56e09 tempest-SecurityGroupsTestJSON-960025904 tempest-SecurityGroupsTestJSON-960025904-project-member] Enqueued Resource ID: cbfc1dea-3e2d-4303-95a0-e82a6c64f3c7 with Priority: HIGHEST for action security_group_members [ 873.162090] env[65306]: INFO networking_nsxv3.common.synchronization [req-04df3d18-e3c6-4cba-bbcf-48d5cc19840b req-c055a5b0-da80-4967-b8b8-6f34aeb56e09 tempest-SecurityGroupsTestJSON-960025904 tempest-SecurityGroupsTestJSON-960025904-project-member] Enqueued Resource ID: e02bffcf-337d-4619-9629-a50e2941c30d with Priority: HIGHEST for action port [ 873.163749] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4e234e08-a192-4c7a-badf-3e57629854d7 with Priority: HIGHEST for action security_group_rules [ 873.163749] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 99194846-a5d9-4dff-8a78-5c66da2ee811 with Priority: HIGHEST for action security_group_rules [ 873.163749] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cbfc1dea-3e2d-4303-95a0-e82a6c64f3c7 with Priority: HIGHEST for action security_group_members [ 873.163749] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e02bffcf-337d-4619-9629-a50e2941c30d with Priority: HIGHEST for action port [ 873.163749] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cbfc1dea-3e2d-4303-95a0-e82a6c64f3c7 with Priority: HIGHEST for action security_group_rules [ 873.164576] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4e234e08-a192-4c7a-badf-3e57629854d7 with Priority: HIGHEST for action security_group_members [ 873.164678] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 99194846-a5d9-4dff-8a78-5c66da2ee811 with Priority: HIGHEST for action security_group_members [ 873.165466] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4e234e08-a192-4c7a-badf-3e57629854d7 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.165466] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4e234e08-a192-4c7a-badf-3e57629854d7" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.165466] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4e234e08-a192-4c7a-badf-3e57629854d7" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.168046] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4e234e08-a192-4c7a-badf-3e57629854d7" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.168046] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4e234e08-a192-4c7a-badf-3e57629854d7',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 873.168046] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock rules-99194846-a5d9-4dff-8a78-5c66da2ee811 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.168046] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-99194846-a5d9-4dff-8a78-5c66da2ee811" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.168046] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-99194846-a5d9-4dff-8a78-5c66da2ee811" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.168046] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-99194846-a5d9-4dff-8a78-5c66da2ee811" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.168046] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('99194846-a5d9-4dff-8a78-5c66da2ee811',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 873.168503] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-cbfc1dea-3e2d-4303-95a0-e82a6c64f3c7 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.168552] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cbfc1dea-3e2d-4303-95a0-e82a6c64f3c7" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.168901] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock port-e02bffcf-337d-4619-9629-a50e2941c30d taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.168901] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e02bffcf-337d-4619-9629-a50e2941c30d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.169165] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e02bffcf-337d-4619-9629-a50e2941c30d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.169244] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e02bffcf-337d-4619-9629-a50e2941c30d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.169346] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e02bffcf-337d-4619-9629-a50e2941c30d',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 873.170252] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cbfc1dea-3e2d-4303-95a0-e82a6c64f3c7 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.170451] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cbfc1dea-3e2d-4303-95a0-e82a6c64f3c7" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.170451] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cbfc1dea-3e2d-4303-95a0-e82a6c64f3c7" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.170698] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cbfc1dea-3e2d-4303-95a0-e82a6c64f3c7" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.171855] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cbfc1dea-3e2d-4303-95a0-e82a6c64f3c7',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 873.174831] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-4e234e08-a192-4c7a-badf-3e57629854d7 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.175010] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4e234e08-a192-4c7a-badf-3e57629854d7" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.175223] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-99194846-a5d9-4dff-8a78-5c66da2ee811 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.175347] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-99194846-a5d9-4dff-8a78-5c66da2ee811" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.400543] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-9e80329d-1fcd-4c50-8991-a90e2a1fbdbc taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.400759] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9e80329d-1fcd-4c50-8991-a90e2a1fbdbc" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.400816] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9e80329d-1fcd-4c50-8991-a90e2a1fbdbc" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.401820] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9e80329d-1fcd-4c50-8991-a90e2a1fbdbc" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.401820] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.401820] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.401820] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.401820] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.401820] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.401820] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9e80329d-1fcd-4c50-8991-a90e2a1fbdbc" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.401820] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-9e80329d-1fcd-4c50-8991-a90e2a1fbdbc taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.402215] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9e80329d-1fcd-4c50-8991-a90e2a1fbdbc" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.402215] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9e80329d-1fcd-4c50-8991-a90e2a1fbdbc" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.402215] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9e80329d-1fcd-4c50-8991-a90e2a1fbdbc" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.402321] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.402363] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.402424] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.402556] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.402625] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.402702] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9e80329d-1fcd-4c50-8991-a90e2a1fbdbc" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.402789] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9e80329d-1fcd-4c50-8991-a90e2a1fbdbc',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 873.576886] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('99194846-a5d9-4dff-8a78-5c66da2ee811',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 873.577833] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cbfc1dea-3e2d-4303-95a0-e82a6c64f3c7',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 873.578602] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4e234e08-a192-4c7a-badf-3e57629854d7',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 873.677303] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-4e234e08-a192-4c7a-badf-3e57629854d7 taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.677420] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4e234e08-a192-4c7a-badf-3e57629854d7" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.677615] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e02bffcf-337d-4619-9629-a50e2941c30d with status ACTIVE [ 873.678021] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.678503] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.678503] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.679516] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.679516] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.679516] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.679516] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.679516] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.679516] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.679840] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.679840] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.679840] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.679962] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.680088] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.680167] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.680252] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e02bffcf-337d-4619-9629-a50e2941c30d is going to be updated. [ 873.682482] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-99194846-a5d9-4dff-8a78-5c66da2ee811 taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.682482] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-99194846-a5d9-4dff-8a78-5c66da2ee811" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.682696] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-cbfc1dea-3e2d-4303-95a0-e82a6c64f3c7 taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.682770] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cbfc1dea-3e2d-4303-95a0-e82a6c64f3c7" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.705990] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.706161] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.706227] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.706469] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.706619] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.706775] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e02bffcf-337d-4619-9629-a50e2941c30d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.904692] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9e80329d-1fcd-4c50-8991-a90e2a1fbdbc: rpc.has_security_group_logging(os_id): False [ 873.939105] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.939354] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.939405] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.939603] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.939698] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.939965] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.940298] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.940298] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.940566] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.940613] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.941076] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.941180] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.941269] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.941471] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.941557] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.941813] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.941933] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.942016] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.942308] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.942308] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.942386] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9e80329d-1fcd-4c50-8991-a90e2a1fbdbc is going to be updated. [ 874.051449] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.051594] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.051651] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.051894] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.052057] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.075596] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9e80329d-1fcd-4c50-8991-a90e2a1fbdbc in Status: IN_PROGRESS for 2s [ 874.080600] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('99194846-a5d9-4dff-8a78-5c66da2ee811',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 874.083359] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cbfc1dea-3e2d-4303-95a0-e82a6c64f3c7',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 874.085168] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4e234e08-a192-4c7a-badf-3e57629854d7',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 874.583414] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.583876] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.583876] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.583876] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.584045] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.584094] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 99194846-a5d9-4dff-8a78-5c66da2ee811 is going to be updated. [ 874.586343] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.586343] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.586343] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.586343] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.586343] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.586343] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cbfc1dea-3e2d-4303-95a0-e82a6c64f3c7 is going to be created. [ 874.588576] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.588765] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.588819] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.589035] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.589132] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.589218] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4e234e08-a192-4c7a-badf-3e57629854d7 is going to be updated. [ 874.667165] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.667433] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.667433] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.667724] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.667957] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.683438] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.683674] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.683740] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.684023] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.684201] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.686602] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.686769] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.686850] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.687117] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.687307] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.689576] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0cb41b0f-cdd2-4222-95b4-bafd614b7460 in Status: SUCCESS [ 874.689803] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0cb41b0f-cdd2-4222-95b4-bafd614b7460" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.690538] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0cb41b0f-cdd2-4222-95b4-bafd614b7460" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.690870] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0cb41b0f-cdd2-4222-95b4-bafd614b7460" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.691124] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.691261] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.691331] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.691509] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.691596] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.691688] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0cb41b0f-cdd2-4222-95b4-bafd614b7460" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.691788] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0cb41b0f-cdd2-4222-95b4-bafd614b7460',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 874.694431] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cbfc1dea-3e2d-4303-95a0-e82a6c64f3c7 in Status: UNINITIALIZED for 2s [ 874.704208] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4e234e08-a192-4c7a-badf-3e57629854d7 in Status: IN_PROGRESS for 2s [ 874.704208] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 99194846-a5d9-4dff-8a78-5c66da2ee811 in Status: IN_PROGRESS for 2s [ 875.068534] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dbcb04c7-d4cb-4ab9-8312-c80dffeeaa42 in Status: SUCCESS [ 875.068534] env[65306]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dbcb04c7-d4cb-4ab9-8312-c80dffeeaa42 deletion is rescheduled due to dependency. [ 875.068880] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dbcb04c7-d4cb-4ab9-8312-c80dffeeaa42" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.069727] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c3ffb1bc-84c3-4121-a677-8d413e70c9cc in Status: SUCCESS [ 875.070305] env[65306]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c3ffb1bc-84c3-4121-a677-8d413e70c9cc deletion is rescheduled due to dependency. [ 875.070305] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c3ffb1bc-84c3-4121-a677-8d413e70c9cc" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.196279] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-0cb41b0f-cdd2-4222-95b4-bafd614b7460 taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.196528] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0cb41b0f-cdd2-4222-95b4-bafd614b7460" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.196622] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0cb41b0f-cdd2-4222-95b4-bafd614b7460" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.196961] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0cb41b0f-cdd2-4222-95b4-bafd614b7460" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.197561] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.197823] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.197967] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.198352] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.198486] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.198706] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0cb41b0f-cdd2-4222-95b4-bafd614b7460" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.199012] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-0cb41b0f-cdd2-4222-95b4-bafd614b7460 taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.200610] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0cb41b0f-cdd2-4222-95b4-bafd614b7460" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.200699] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0cb41b0f-cdd2-4222-95b4-bafd614b7460" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.201075] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0cb41b0f-cdd2-4222-95b4-bafd614b7460" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.201408] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.201536] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.201645] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.202094] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.202192] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.202291] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0cb41b0f-cdd2-4222-95b4-bafd614b7460" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.202423] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0cb41b0f-cdd2-4222-95b4-bafd614b7460',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 875.712159] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0cb41b0f-cdd2-4222-95b4-bafd614b7460: rpc.has_security_group_logging(os_id): False [ 875.730346] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.730551] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.730551] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.730807] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.731019] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.731203] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.731304] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.731390] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.731527] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.731605] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.731804] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.732065] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.732065] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.732141] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.732179] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.732360] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.732892] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.732892] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.732892] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.732892] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.732892] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0cb41b0f-cdd2-4222-95b4-bafd614b7460 is going to be created. [ 875.806363] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.806581] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.806687] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.806942] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.807189] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.822570] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0cb41b0f-cdd2-4222-95b4-bafd614b7460 in Status: IN_PROGRESS for 2s [ 876.075058] env[65306]: INFO networking_nsxv3.common.synchronization [req-10c35ac8-9ebe-49d2-9191-0799980e2b31 req-c6177de4-ac94-4aee-b753-a13441ee2f28 tempest-ServerActionsTestOtherB-1027609472 tempest-ServerActionsTestOtherB-1027609472-project-member] Enqueued Resource ID: 37349b8b-c2c1-4141-8b10-752c27492cbd with Priority: HIGHEST for action security_group_members [ 876.075659] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 37349b8b-c2c1-4141-8b10-752c27492cbd with Priority: HIGHEST for action security_group_members [ 876.077071] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-37349b8b-c2c1-4141-8b10-752c27492cbd taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.077071] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-37349b8b-c2c1-4141-8b10-752c27492cbd" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.077071] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-37349b8b-c2c1-4141-8b10-752c27492cbd" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.077278] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-37349b8b-c2c1-4141-8b10-752c27492cbd" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.077533] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.078168] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.078168] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.078168] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.078168] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.078601] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('37349b8b-c2c1-4141-8b10-752c27492cbd',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 876.096325] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9e80329d-1fcd-4c50-8991-a90e2a1fbdbc in Status: SUCCESS [ 876.096947] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9e80329d-1fcd-4c50-8991-a90e2a1fbdbc" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.581017] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.581249] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.581324] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.581539] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.581631] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.581867] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.582990] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.582990] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.582990] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.582990] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.582990] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 37349b8b-c2c1-4141-8b10-752c27492cbd is going to be updated. [ 876.621726] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.622541] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.622541] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.623024] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.623896] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.636330] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 37349b8b-c2c1-4141-8b10-752c27492cbd in Status: IN_PROGRESS for 2s [ 876.707176] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cbfc1dea-3e2d-4303-95a0-e82a6c64f3c7 in Status: SUCCESS [ 876.707606] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cbfc1dea-3e2d-4303-95a0-e82a6c64f3c7" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.708086] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cbfc1dea-3e2d-4303-95a0-e82a6c64f3c7" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.708337] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cbfc1dea-3e2d-4303-95a0-e82a6c64f3c7" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.708526] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.708639] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.708701] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.708853] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.708929] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.709033] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cbfc1dea-3e2d-4303-95a0-e82a6c64f3c7',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 876.714675] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4e234e08-a192-4c7a-badf-3e57629854d7 in Status: SUCCESS [ 876.714966] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4e234e08-a192-4c7a-badf-3e57629854d7" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.715129] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4e234e08-a192-4c7a-badf-3e57629854d7" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.715464] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4e234e08-a192-4c7a-badf-3e57629854d7" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.715980] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.715980] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.715980] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.716404] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.716404] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.716404] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4e234e08-a192-4c7a-badf-3e57629854d7',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 876.719106] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 99194846-a5d9-4dff-8a78-5c66da2ee811 in Status: SUCCESS [ 876.719339] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-99194846-a5d9-4dff-8a78-5c66da2ee811" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.719444] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-99194846-a5d9-4dff-8a78-5c66da2ee811" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.719602] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-99194846-a5d9-4dff-8a78-5c66da2ee811" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.719782] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.719906] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.719956] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.721477] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.721955] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.721955] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('99194846-a5d9-4dff-8a78-5c66da2ee811',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 876.899489] env[65306]: INFO networking_nsxv3.common.synchronization [req-e7de8885-2e3f-45c9-90c3-1b5892061731 req-0390125b-e796-4be8-bd22-9fb837349c9c tempest-ServerPasswordTestJSON-1529732582 tempest-ServerPasswordTestJSON-1529732582-project-member] Enqueued Resource ID: b9d469db-f694-4408-9c06-70ff03328f59 with Priority: HIGHEST for action security_group_members [ 876.900455] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b9d469db-f694-4408-9c06-70ff03328f59 with Priority: HIGHEST for action security_group_members [ 876.900455] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-b9d469db-f694-4408-9c06-70ff03328f59 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.900651] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b9d469db-f694-4408-9c06-70ff03328f59" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.900651] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b9d469db-f694-4408-9c06-70ff03328f59" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.900903] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b9d469db-f694-4408-9c06-70ff03328f59" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.900974] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.901447] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.901538] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.901687] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.901802] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.901905] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b9d469db-f694-4408-9c06-70ff03328f59',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 877.211237] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cbfc1dea-3e2d-4303-95a0-e82a6c64f3c7',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 877.224402] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4e234e08-a192-4c7a-badf-3e57629854d7',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 877.226040] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('99194846-a5d9-4dff-8a78-5c66da2ee811',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 877.337658] env[65306]: INFO networking_nsxv3.common.synchronization [req-9636fe65-bc44-4e6c-ad68-d4d1f7dd50cd req-3d728fea-edc4-45a5-9d11-fe5655531926 tempest-SecurityGroupsTestJSON-960025904 tempest-SecurityGroupsTestJSON-960025904-project-member] Enqueued Resource ID: 99194846-a5d9-4dff-8a78-5c66da2ee811 with Priority: HIGHEST for action security_group_members [ 877.337845] env[65306]: INFO networking_nsxv3.common.synchronization [req-9636fe65-bc44-4e6c-ad68-d4d1f7dd50cd req-3d728fea-edc4-45a5-9d11-fe5655531926 tempest-SecurityGroupsTestJSON-960025904 tempest-SecurityGroupsTestJSON-960025904-project-member] Enqueued Resource ID: 4e234e08-a192-4c7a-badf-3e57629854d7 with Priority: HIGHEST for action security_group_members [ 877.337982] env[65306]: INFO networking_nsxv3.common.synchronization [req-9636fe65-bc44-4e6c-ad68-d4d1f7dd50cd req-3d728fea-edc4-45a5-9d11-fe5655531926 tempest-SecurityGroupsTestJSON-960025904 tempest-SecurityGroupsTestJSON-960025904-project-member] Enqueued Resource ID: cbfc1dea-3e2d-4303-95a0-e82a6c64f3c7 with Priority: HIGHEST for action security_group_members [ 877.338537] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 99194846-a5d9-4dff-8a78-5c66da2ee811 with Priority: HIGHEST for action security_group_members [ 877.338673] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4e234e08-a192-4c7a-badf-3e57629854d7 with Priority: HIGHEST for action security_group_members [ 877.338773] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cbfc1dea-3e2d-4303-95a0-e82a6c64f3c7 with Priority: HIGHEST for action security_group_members [ 877.340314] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-99194846-a5d9-4dff-8a78-5c66da2ee811 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.340528] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-99194846-a5d9-4dff-8a78-5c66da2ee811" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.340857] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-4e234e08-a192-4c7a-badf-3e57629854d7 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.341018] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4e234e08-a192-4c7a-badf-3e57629854d7" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.341317] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-cbfc1dea-3e2d-4303-95a0-e82a6c64f3c7 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.341492] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cbfc1dea-3e2d-4303-95a0-e82a6c64f3c7" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.404475] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.404672] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.404723] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.404937] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.405052] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.405653] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.405653] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.405653] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.405653] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.405653] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.405847] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b9d469db-f694-4408-9c06-70ff03328f59 is going to be updated. [ 877.441284] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.441466] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.441564] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.441874] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.442100] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.451953] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b9d469db-f694-4408-9c06-70ff03328f59 in Status: IN_PROGRESS for 2s [ 877.714327] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cbfc1dea-3e2d-4303-95a0-e82a6c64f3c7',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 877.729025] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4e234e08-a192-4c7a-badf-3e57629854d7',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 877.729867] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('99194846-a5d9-4dff-8a78-5c66da2ee811',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 877.841194] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0cb41b0f-cdd2-4222-95b4-bafd614b7460 in Status: SUCCESS [ 877.841269] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0cb41b0f-cdd2-4222-95b4-bafd614b7460" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.216847] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.217030] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.217108] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.217331] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.217420] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.217520] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cbfc1dea-3e2d-4303-95a0-e82a6c64f3c7 is going to be updated. [ 878.231902] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.232067] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.232207] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.232750] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.232750] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.232750] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4e234e08-a192-4c7a-badf-3e57629854d7 is going to be updated. [ 878.236232] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.236232] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.236232] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.236232] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.236232] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.236232] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 99194846-a5d9-4dff-8a78-5c66da2ee811 is going to be updated. [ 878.262469] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.262469] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.262469] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.262469] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.262469] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.272039] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.272195] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.272268] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.272476] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.272612] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.274806] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.274994] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.275056] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.275272] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.275360] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.276901] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cbfc1dea-3e2d-4303-95a0-e82a6c64f3c7 in Status: IN_PROGRESS for 2s [ 878.285687] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 99194846-a5d9-4dff-8a78-5c66da2ee811 in Status: IN_PROGRESS for 2s [ 878.287796] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4e234e08-a192-4c7a-badf-3e57629854d7 in Status: IN_PROGRESS for 2s [ 878.646448] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 37349b8b-c2c1-4141-8b10-752c27492cbd in Status: SUCCESS [ 878.646598] env[65306]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 37349b8b-c2c1-4141-8b10-752c27492cbd deletion is rescheduled due to dependency. [ 878.646711] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-37349b8b-c2c1-4141-8b10-752c27492cbd" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.463382] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b9d469db-f694-4408-9c06-70ff03328f59 in Status: SUCCESS [ 879.467100] env[65306]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b9d469db-f694-4408-9c06-70ff03328f59 deletion is rescheduled due to dependency. [ 879.467100] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b9d469db-f694-4408-9c06-70ff03328f59" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.289403] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cbfc1dea-3e2d-4303-95a0-e82a6c64f3c7 in Status: SUCCESS [ 880.289736] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cbfc1dea-3e2d-4303-95a0-e82a6c64f3c7" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.290972] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cbfc1dea-3e2d-4303-95a0-e82a6c64f3c7" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.292880] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cbfc1dea-3e2d-4303-95a0-e82a6c64f3c7" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.292880] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.292880] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.292880] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.292880] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.292880] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.292880] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cbfc1dea-3e2d-4303-95a0-e82a6c64f3c7" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.292880] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('cbfc1dea-3e2d-4303-95a0-e82a6c64f3c7',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 880.294242] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cbfc1dea-3e2d-4303-95a0-e82a6c64f3c7" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.295865] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cbfc1dea-3e2d-4303-95a0-e82a6c64f3c7" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.295865] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.295865] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.295865] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.295865] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.295865] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.295865] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cbfc1dea-3e2d-4303-95a0-e82a6c64f3c7',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 880.303940] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 99194846-a5d9-4dff-8a78-5c66da2ee811 in Status: SUCCESS [ 880.303940] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-99194846-a5d9-4dff-8a78-5c66da2ee811" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.303940] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-99194846-a5d9-4dff-8a78-5c66da2ee811" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.303940] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-99194846-a5d9-4dff-8a78-5c66da2ee811" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.303940] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.303940] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.303940] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.304466] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.304466] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.304466] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-99194846-a5d9-4dff-8a78-5c66da2ee811" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.304466] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('99194846-a5d9-4dff-8a78-5c66da2ee811',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 880.306358] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4e234e08-a192-4c7a-badf-3e57629854d7 in Status: SUCCESS [ 880.306577] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4e234e08-a192-4c7a-badf-3e57629854d7" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.306749] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-99194846-a5d9-4dff-8a78-5c66da2ee811" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.306929] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-99194846-a5d9-4dff-8a78-5c66da2ee811" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.307153] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.307311] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.307405] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.307613] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.307716] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.308177] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('99194846-a5d9-4dff-8a78-5c66da2ee811',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 880.308910] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4e234e08-a192-4c7a-badf-3e57629854d7" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.310775] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4e234e08-a192-4c7a-badf-3e57629854d7" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.311455] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.311455] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.311455] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.311455] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.311707] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.311707] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4e234e08-a192-4c7a-badf-3e57629854d7" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.311788] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4e234e08-a192-4c7a-badf-3e57629854d7',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 880.313389] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4e234e08-a192-4c7a-badf-3e57629854d7" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.313618] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4e234e08-a192-4c7a-badf-3e57629854d7" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.313808] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.314078] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.314078] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.314633] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.314728] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.314829] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4e234e08-a192-4c7a-badf-3e57629854d7',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 880.430888] env[65306]: INFO networking_nsxv3.common.synchronization [req-e271308d-b505-4584-b932-e4c35c5ac801 req-a3bcf709-277a-4cfb-88e7-678cf5cc2582 tempest-ServerActionsV293TestJSON-2007661909 tempest-ServerActionsV293TestJSON-2007661909-project-member] Enqueued Resource ID: e21f899c-0473-418d-9b8f-8591e9dc160f with Priority: HIGHEST for action security_group_members [ 880.431837] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e21f899c-0473-418d-9b8f-8591e9dc160f with Priority: HIGHEST for action security_group_members [ 880.431837] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-e21f899c-0473-418d-9b8f-8591e9dc160f taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.432018] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e21f899c-0473-418d-9b8f-8591e9dc160f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.432018] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e21f899c-0473-418d-9b8f-8591e9dc160f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.432400] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e21f899c-0473-418d-9b8f-8591e9dc160f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.432445] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.432831] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.432831] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.432831] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.433296] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.433296] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e21f899c-0473-418d-9b8f-8591e9dc160f',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 880.625403] env[65306]: INFO networking_nsxv3.common.synchronization [req-eba1fec2-dd9e-4b45-9340-5840716f70b5 req-a12225df-d126-4e08-9ace-e291c735997e tempest-ServerMetadataTestJSON-1278073267 tempest-ServerMetadataTestJSON-1278073267-project-member] Enqueued Resource ID: 23ae6942-da1d-46a7-951e-aa32b51f50d2 with Priority: HIGHEST for action security_group_members [ 880.625959] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 23ae6942-da1d-46a7-951e-aa32b51f50d2 with Priority: HIGHEST for action security_group_members [ 880.626327] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-23ae6942-da1d-46a7-951e-aa32b51f50d2 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.626605] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-23ae6942-da1d-46a7-951e-aa32b51f50d2" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.626605] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-23ae6942-da1d-46a7-951e-aa32b51f50d2" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.628724] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-23ae6942-da1d-46a7-951e-aa32b51f50d2" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.630463] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.630609] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.630677] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.631098] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.631098] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.631254] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('23ae6942-da1d-46a7-951e-aa32b51f50d2',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 880.795020] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('cbfc1dea-3e2d-4303-95a0-e82a6c64f3c7',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 880.800622] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.800622] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.800622] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.800622] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.800622] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.800622] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.800622] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.800622] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.800622] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.800622] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.800622] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cbfc1dea-3e2d-4303-95a0-e82a6c64f3c7 is going to be deleted. [ 880.815039] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('99194846-a5d9-4dff-8a78-5c66da2ee811',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 880.815039] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.815039] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.815039] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.815039] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.815533] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.817033] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.817033] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.817033] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.817033] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.817033] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.817033] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 99194846-a5d9-4dff-8a78-5c66da2ee811 is going to be updated. [ 880.817803] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-4e234e08-a192-4c7a-badf-3e57629854d7 taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.817977] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4e234e08-a192-4c7a-badf-3e57629854d7" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.818203] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4e234e08-a192-4c7a-badf-3e57629854d7',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 880.834591] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.836019] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.836019] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.836019] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.836019] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.836019] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cbfc1dea-3e2d-4303-95a0-e82a6c64f3c7" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.852041] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.852041] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.852041] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.852041] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.852373] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.864916] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 99194846-a5d9-4dff-8a78-5c66da2ee811 in Status: IN_PROGRESS for 2s [ 880.936568] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.936568] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.936568] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.936568] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.936568] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.936568] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.936823] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.936823] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.936823] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.936912] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.936965] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e21f899c-0473-418d-9b8f-8591e9dc160f is going to be updated. [ 880.971476] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.971665] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.971713] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.972785] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.972785] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.983249] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e21f899c-0473-418d-9b8f-8591e9dc160f in Status: IN_PROGRESS for 2s [ 881.082913] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock network-414 taken with stack trace [, , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.083154] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "network-414" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.083256] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "network-414" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.083581] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "network-414" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.083859] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.084011] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.084180] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.084351] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.084490] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.084699] env[65306]: DEBUG dogpile.cache.region [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] No value present for key: 'zone-id' {{(pid=65306) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 881.084809] env[65306]: DEBUG dogpile.lock [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] NeedRegenerationException {{(pid=65306) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 881.084961] env[65306]: DEBUG dogpile.lock [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] no value, waiting for create lock {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 881.085036] env[65306]: DEBUG dogpile.lock [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] value creation lock acquired {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 881.085194] env[65306]: DEBUG dogpile.cache.region [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] No value present for key: 'zone-id' {{(pid=65306) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 881.085327] env[65306]: DEBUG dogpile.lock [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Calling creation function for not-yet-present value {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 881.085433] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 881.114206] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 881.115310] env[65306]: DEBUG dogpile.cache.region [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Cache value generated in 0.030 seconds for key(s): 'zone-id' {{(pid=65306) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 881.115480] env[65306]: DEBUG dogpile.lock [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Released creation lock {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 881.115668] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "network-414" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.117188] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock port-c03e4bf3-a078-49b3-a29b-7b7588739adc taken with stack trace [, , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.117188] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "port-c03e4bf3-a078-49b3-a29b-7b7588739adc" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.117188] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "port-c03e4bf3-a078-49b3-a29b-7b7588739adc" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.117188] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "port-c03e4bf3-a078-49b3-a29b-7b7588739adc" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.117188] env[65306]: DEBUG networking_nsxv3.api.rpc [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c03e4bf3-a078-49b3-a29b-7b7588739adc',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 881.133815] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.134634] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.134634] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.134634] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.134634] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.135060] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.135060] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.135060] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.135370] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.135370] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.135370] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 23ae6942-da1d-46a7-951e-aa32b51f50d2 already deleted. [ 881.135370] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-23ae6942-da1d-46a7-951e-aa32b51f50d2" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.302382] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for cbfc1dea-3e2d-4303-95a0-e82a6c64f3c7: rpc.has_security_group_logging(os_id): False [ 881.320862] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 99194846-a5d9-4dff-8a78-5c66da2ee811: rpc.has_security_group_logging(os_id): False [ 881.320862] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4e234e08-a192-4c7a-badf-3e57629854d7',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 881.336944] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.337151] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.337151] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.337813] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.337813] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.337813] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.337813] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.337813] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.338061] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.338061] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.338196] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cbfc1dea-3e2d-4303-95a0-e82a6c64f3c7 is going to be created. [ 881.348692] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.348870] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.349008] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.349122] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.349213] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.349440] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.349541] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.349605] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.349754] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.349828] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.349918] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 99194846-a5d9-4dff-8a78-5c66da2ee811 is going to be updated. [ 881.378762] env[65306]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/cbfc1dea-3e2d-4303-95a0-e82a6c64f3c7], does not exist path=[/infra/domains/default/groups/cbfc1dea-3e2d-4303-95a0-e82a6c64f3c7]."\n}' [ 881.378929] env[65306]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cbfc1dea-3e2d-4303-95a0-e82a6c64f3c7 failed to be updated, retrying after metadata refresh: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/cbfc1dea-3e2d-4303-95a0-e82a6c64f3c7 [ 881.378998] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 881.437162] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.437335] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.437392] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.437597] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.438706] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.439132] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.439280] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.439392] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.439590] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.439676] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.439901] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.440014] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.440074] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.440237] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.440328] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.440381] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cbfc1dea-3e2d-4303-95a0-e82a6c64f3c7 is going to be created. [ 881.453158] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.453379] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.453471] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.453944] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.454195] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.466865] env[65306]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/cbfc1dea-3e2d-4303-95a0-e82a6c64f3c7], does not exist path=[/infra/domains/default/groups/cbfc1dea-3e2d-4303-95a0-e82a6c64f3c7]."\n}': requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/cbfc1dea-3e2d-4303-95a0-e82a6c64f3c7 [ 881.467585] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cbfc1dea-3e2d-4303-95a0-e82a6c64f3c7" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.467585] env[65306]: Traceback (most recent call last): [ 881.467585] env[65306]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 36, in wrapper [ 881.467585] env[65306]: return func(*args, **kwargs) [ 881.467585] env[65306]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 881.467585] env[65306]: res.raise_for_status() [ 881.467585] env[65306]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1026, in raise_for_status [ 881.467585] env[65306]: raise HTTPError(http_error_msg, response=self) [ 881.467585] env[65306]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/cbfc1dea-3e2d-4303-95a0-e82a6c64f3c7 [ 881.467585] env[65306]: During handling of the above exception, another exception occurred: [ 881.467585] env[65306]: Traceback (most recent call last): [ 881.467585] env[65306]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/hubs/poll.py", line 111, in wait [ 881.467585] env[65306]: listener.cb(fileno) [ 881.467585] env[65306]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py", line 272, in main [ 881.467585] env[65306]: result = function(*args, **kwargs) [ 881.467585] env[65306]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py", line 210, in security_group_rules [ 881.467585] env[65306]: self.nsx_provider.sg_rules_realize(os_sg, logged=logged) [ 881.467585] env[65306]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 1012, in sg_rules_realize [ 881.467585] env[65306]: return self._realize(Provider.SG_RULES, delete, self.payload.sg_rules_container, os_sg, provider_sg) [ 881.467585] env[65306]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 45, in wrapper [ 881.467585] env[65306]: return func(self, resource_type, delete, self.payload.sg_rules_container, os_obj, provider_sg) [ 881.467585] env[65306]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 881.467585] env[65306]: res.raise_for_status() [ 881.467585] env[65306]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1026, in raise_for_status [ 881.467585] env[65306]: raise HTTPError(http_error_msg, response=self) [ 881.467585] env[65306]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/cbfc1dea-3e2d-4303-95a0-e82a6c64f3c7 [ 881.467585] env[65306]: Removing descriptor: 61 [ 881.470528] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 99194846-a5d9-4dff-8a78-5c66da2ee811 in Status: IN_PROGRESS for 2s [ 881.619882] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.620128] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.620252] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.621751] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.621751] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.621751] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Segment Port c03e4bf3-a078-49b3-a29b-7b7588739adc not found, creating... [ 881.621751] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.621751] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.621751] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.621751] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.621751] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.622360] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.622421] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.622575] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.622728] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.622856] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.622994] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Resource: SegmentPort with ID: c03e4bf3-a078-49b3-a29b-7b7588739adc is going to be created. [ 881.648987] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.649846] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.649846] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.650077] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.650253] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.650482] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "port-c03e4bf3-a078-49b3-a29b-7b7588739adc" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.823540] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.823804] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.823867] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.824133] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.824339] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.824594] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4e234e08-a192-4c7a-badf-3e57629854d7 is going to be updated. [ 881.856694] env[65306]: INFO networking_nsxv3.common.synchronization [req-0c914f42-411b-4703-a560-1a1d99ea521a req-3369496b-464d-4a5e-9396-8e3a6a25839f tempest-ImagesOneServerNegativeTestJSON-105192947 tempest-ImagesOneServerNegativeTestJSON-105192947-project-member] Enqueued Resource ID: aceee07e-3675-474c-96e8-9fe510f1356f with Priority: HIGHEST for action security_group_members [ 881.857842] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aceee07e-3675-474c-96e8-9fe510f1356f with Priority: HIGHEST for action security_group_members [ 881.858321] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-aceee07e-3675-474c-96e8-9fe510f1356f taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.858514] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aceee07e-3675-474c-96e8-9fe510f1356f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.858619] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aceee07e-3675-474c-96e8-9fe510f1356f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.859012] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aceee07e-3675-474c-96e8-9fe510f1356f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.859255] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.859413] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.859515] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.859738] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.859870] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.860011] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('aceee07e-3675-474c-96e8-9fe510f1356f',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 881.865015] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.865211] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.865276] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.865476] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.865676] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.879063] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4e234e08-a192-4c7a-badf-3e57629854d7 in Status: IN_PROGRESS for 2s [ 882.368697] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.369247] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.369455] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.369737] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.392127] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.392451] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.392612] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.392682] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.392882] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.393026] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.393262] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aceee07e-3675-474c-96e8-9fe510f1356f is going to be updated. [ 882.424419] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.424575] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.424997] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.424997] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.424997] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.435105] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aceee07e-3675-474c-96e8-9fe510f1356f in Status: IN_PROGRESS for 2s [ 882.859933] env[65306]: INFO networking_nsxv3.common.synchronization [req-eba1fec2-dd9e-4b45-9340-5840716f70b5 req-f29f3691-07cb-4ad5-a282-55d3fab5d111 service nova] Enqueued Resource ID: 23ae6942-da1d-46a7-951e-aa32b51f50d2 with Priority: HIGHEST for action security_group_rules [ 882.860214] env[65306]: INFO networking_nsxv3.common.synchronization [req-eba1fec2-dd9e-4b45-9340-5840716f70b5 req-f29f3691-07cb-4ad5-a282-55d3fab5d111 service nova] Enqueued Resource ID: 23ae6942-da1d-46a7-951e-aa32b51f50d2 with Priority: HIGHEST for action security_group_members [ 882.860256] env[65306]: INFO networking_nsxv3.common.synchronization [req-eba1fec2-dd9e-4b45-9340-5840716f70b5 req-f29f3691-07cb-4ad5-a282-55d3fab5d111 service nova] Enqueued Resource ID: c03e4bf3-a078-49b3-a29b-7b7588739adc with Priority: HIGHEST for action port [ 882.860779] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 23ae6942-da1d-46a7-951e-aa32b51f50d2 with Priority: HIGHEST for action security_group_rules [ 882.861023] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 23ae6942-da1d-46a7-951e-aa32b51f50d2 with Priority: HIGHEST for action security_group_members [ 882.864680] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c03e4bf3-a078-49b3-a29b-7b7588739adc with Priority: HIGHEST for action port [ 882.865285] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock rules-23ae6942-da1d-46a7-951e-aa32b51f50d2 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.865483] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-23ae6942-da1d-46a7-951e-aa32b51f50d2" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.865595] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-23ae6942-da1d-46a7-951e-aa32b51f50d2" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.865897] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-23ae6942-da1d-46a7-951e-aa32b51f50d2" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.866740] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('23ae6942-da1d-46a7-951e-aa32b51f50d2',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 882.868717] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-23ae6942-da1d-46a7-951e-aa32b51f50d2 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.869788] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-23ae6942-da1d-46a7-951e-aa32b51f50d2" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.869922] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-23ae6942-da1d-46a7-951e-aa32b51f50d2" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.870379] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-23ae6942-da1d-46a7-951e-aa32b51f50d2" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.871297] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.871483] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.873298] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.873568] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.873731] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.873938] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('23ae6942-da1d-46a7-951e-aa32b51f50d2',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 882.875504] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock port-c03e4bf3-a078-49b3-a29b-7b7588739adc taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.875628] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c03e4bf3-a078-49b3-a29b-7b7588739adc" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.875729] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c03e4bf3-a078-49b3-a29b-7b7588739adc" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.875870] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c03e4bf3-a078-49b3-a29b-7b7588739adc" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.875953] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c03e4bf3-a078-49b3-a29b-7b7588739adc',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 882.888939] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 99194846-a5d9-4dff-8a78-5c66da2ee811 in Status: SUCCESS [ 882.888939] env[65306]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 99194846-a5d9-4dff-8a78-5c66da2ee811 deletion is rescheduled due to dependency. [ 882.888939] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-99194846-a5d9-4dff-8a78-5c66da2ee811" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.996498] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e21f899c-0473-418d-9b8f-8591e9dc160f in Status: SUCCESS [ 882.996705] env[65306]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e21f899c-0473-418d-9b8f-8591e9dc160f deletion is rescheduled due to dependency. [ 882.996833] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e21f899c-0473-418d-9b8f-8591e9dc160f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.321036] env[65306]: INFO networking_nsxv3.common.synchronization [req-6fd9783c-1b07-4ff0-a87b-f8b318bb4c32 req-8b74f535-cd17-4df6-842c-b90478ec96a3 tempest-ServerActionsTestJSON-437813836 tempest-ServerActionsTestJSON-437813836-project-member] Enqueued Resource ID: 3bb1834c-39ac-4ba9-bce1-44f7a4805a24 with Priority: HIGHEST for action security_group_members [ 883.321360] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3bb1834c-39ac-4ba9-bce1-44f7a4805a24 with Priority: HIGHEST for action security_group_members [ 883.321700] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-3bb1834c-39ac-4ba9-bce1-44f7a4805a24 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.321838] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3bb1834c-39ac-4ba9-bce1-44f7a4805a24" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.321903] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3bb1834c-39ac-4ba9-bce1-44f7a4805a24" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.322361] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3bb1834c-39ac-4ba9-bce1-44f7a4805a24" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.322599] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.322949] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.323300] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.323300] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.323422] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.323607] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3bb1834c-39ac-4ba9-bce1-44f7a4805a24',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 883.382113] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-23ae6942-da1d-46a7-951e-aa32b51f50d2 taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.382113] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-23ae6942-da1d-46a7-951e-aa32b51f50d2" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.382113] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('23ae6942-da1d-46a7-951e-aa32b51f50d2',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 883.382113] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c03e4bf3-a078-49b3-a29b-7b7588739adc with status ACTIVE [ 883.382113] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.382113] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.382113] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.382113] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.382113] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.382113] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.382113] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.382113] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.382113] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.382113] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.382827] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.382827] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.382827] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.382827] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.382827] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.382827] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c03e4bf3-a078-49b3-a29b-7b7588739adc is going to be updated. [ 883.407749] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.407993] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.407993] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.408319] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.408433] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.408502] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c03e4bf3-a078-49b3-a29b-7b7588739adc" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.491348] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 99194846-a5d9-4dff-8a78-5c66da2ee811 in Status: SUCCESS [ 883.491348] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-99194846-a5d9-4dff-8a78-5c66da2ee811" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.779345] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock network-910 taken with stack trace [, , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.779546] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "network-910" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.779672] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "network-910" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.779932] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "network-910" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.780272] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.780340] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.780467] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.780886] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.780886] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.781119] env[65306]: DEBUG dogpile.cache.region [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] No value present for key: 'zone-id' {{(pid=65306) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 883.781257] env[65306]: DEBUG dogpile.lock [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] NeedRegenerationException {{(pid=65306) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 883.781371] env[65306]: DEBUG dogpile.lock [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] no value, waiting for create lock {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 883.781481] env[65306]: DEBUG dogpile.lock [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] value creation lock acquired {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 883.781593] env[65306]: DEBUG dogpile.cache.region [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] No value present for key: 'zone-id' {{(pid=65306) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 883.781699] env[65306]: DEBUG dogpile.lock [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Calling creation function for not-yet-present value {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 883.782512] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 883.800876] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 883.801098] env[65306]: DEBUG dogpile.cache.region [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=65306) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 883.801246] env[65306]: DEBUG dogpile.lock [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Released creation lock {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 883.801426] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "network-910" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.801752] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock port-8d48b4e8-b60d-4d20-babd-1f3a416c8a92 taken with stack trace [, , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.802079] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "port-8d48b4e8-b60d-4d20-babd-1f3a416c8a92" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.802079] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "port-8d48b4e8-b60d-4d20-babd-1f3a416c8a92" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.802359] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "port-8d48b4e8-b60d-4d20-babd-1f3a416c8a92" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.802501] env[65306]: DEBUG networking_nsxv3.api.rpc [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8d48b4e8-b60d-4d20-babd-1f3a416c8a92',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 883.826162] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.826897] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.826897] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.828361] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.828361] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.828361] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.828361] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.828361] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.828361] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.828361] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.828361] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3bb1834c-39ac-4ba9-bce1-44f7a4805a24 already deleted. [ 883.828361] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3bb1834c-39ac-4ba9-bce1-44f7a4805a24" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.884442] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('23ae6942-da1d-46a7-951e-aa32b51f50d2',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 883.891139] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4e234e08-a192-4c7a-badf-3e57629854d7 in Status: SUCCESS [ 883.891230] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4e234e08-a192-4c7a-badf-3e57629854d7" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.891642] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4e234e08-a192-4c7a-badf-3e57629854d7" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.892012] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4e234e08-a192-4c7a-badf-3e57629854d7" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.892117] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.892231] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.892231] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.892384] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.892533] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.892533] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4e234e08-a192-4c7a-badf-3e57629854d7" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.893207] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-4e234e08-a192-4c7a-badf-3e57629854d7 taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.893207] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4e234e08-a192-4c7a-badf-3e57629854d7" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.893207] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4e234e08-a192-4c7a-badf-3e57629854d7" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.893207] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4e234e08-a192-4c7a-badf-3e57629854d7" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.894269] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.894368] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.894423] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.894779] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.894779] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.895015] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4e234e08-a192-4c7a-badf-3e57629854d7" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.895015] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4e234e08-a192-4c7a-badf-3e57629854d7',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 884.306055] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.306299] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.306299] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.306602] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.306760] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.306914] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Segment Port 8d48b4e8-b60d-4d20-babd-1f3a416c8a92 not found, creating... [ 884.307228] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.307399] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.307515] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.307749] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.307895] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.308217] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.308426] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.308577] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.308808] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.308962] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.309159] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Resource: SegmentPort with ID: 8d48b4e8-b60d-4d20-babd-1f3a416c8a92 is going to be created. [ 884.332172] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.332478] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.332632] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.333390] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.333390] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.333933] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "port-8d48b4e8-b60d-4d20-babd-1f3a416c8a92" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.390719] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.390719] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.390874] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.392121] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.392121] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.392121] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 23ae6942-da1d-46a7-951e-aa32b51f50d2 is going to be created. [ 884.399193] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4e234e08-a192-4c7a-badf-3e57629854d7: rpc.has_security_group_logging(os_id): False [ 884.425019] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.425019] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.425019] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.425019] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.445944] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.446361] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.446590] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.446922] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.447201] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.451996] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aceee07e-3675-474c-96e8-9fe510f1356f in Status: SUCCESS [ 884.451996] env[65306]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aceee07e-3675-474c-96e8-9fe510f1356f deletion is rescheduled due to dependency. [ 884.451996] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aceee07e-3675-474c-96e8-9fe510f1356f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.470781] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.470953] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.471079] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.471147] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.471380] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.471502] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.471754] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.471901] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.471971] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.472177] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.472230] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.472392] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.472489] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.472551] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.472770] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.472848] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.472936] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4e234e08-a192-4c7a-badf-3e57629854d7 is going to be updated. [ 884.475279] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 23ae6942-da1d-46a7-951e-aa32b51f50d2 in Status: UNINITIALIZED for 2s [ 884.587908] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.588190] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.588299] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.588519] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.588666] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.610753] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4e234e08-a192-4c7a-badf-3e57629854d7 in Status: IN_PROGRESS for 2s [ 885.173960] env[65306]: INFO networking_nsxv3.common.synchronization [req-6fd9783c-1b07-4ff0-a87b-f8b318bb4c32 req-64c45d5c-5cba-4f92-a66a-3cf2df4ef0c1 service nova] Enqueued Resource ID: 3bb1834c-39ac-4ba9-bce1-44f7a4805a24 with Priority: HIGHEST for action security_group_rules [ 885.174320] env[65306]: INFO networking_nsxv3.common.synchronization [req-6fd9783c-1b07-4ff0-a87b-f8b318bb4c32 req-64c45d5c-5cba-4f92-a66a-3cf2df4ef0c1 service nova] Enqueued Resource ID: 3bb1834c-39ac-4ba9-bce1-44f7a4805a24 with Priority: HIGHEST for action security_group_members [ 885.174447] env[65306]: INFO networking_nsxv3.common.synchronization [req-6fd9783c-1b07-4ff0-a87b-f8b318bb4c32 req-64c45d5c-5cba-4f92-a66a-3cf2df4ef0c1 service nova] Enqueued Resource ID: 8d48b4e8-b60d-4d20-babd-1f3a416c8a92 with Priority: HIGHEST for action port [ 885.174997] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3bb1834c-39ac-4ba9-bce1-44f7a4805a24 with Priority: HIGHEST for action security_group_rules [ 885.175169] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3bb1834c-39ac-4ba9-bce1-44f7a4805a24 with Priority: HIGHEST for action security_group_members [ 885.175270] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8d48b4e8-b60d-4d20-babd-1f3a416c8a92 with Priority: HIGHEST for action port [ 885.175555] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3bb1834c-39ac-4ba9-bce1-44f7a4805a24 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.175699] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3bb1834c-39ac-4ba9-bce1-44f7a4805a24" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.175768] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3bb1834c-39ac-4ba9-bce1-44f7a4805a24" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.175992] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3bb1834c-39ac-4ba9-bce1-44f7a4805a24" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.176110] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3bb1834c-39ac-4ba9-bce1-44f7a4805a24',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 885.177512] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-3bb1834c-39ac-4ba9-bce1-44f7a4805a24 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.177646] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3bb1834c-39ac-4ba9-bce1-44f7a4805a24" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.177697] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3bb1834c-39ac-4ba9-bce1-44f7a4805a24" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.177879] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3bb1834c-39ac-4ba9-bce1-44f7a4805a24" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.178045] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.178153] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.178211] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.178390] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.178474] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.178568] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3bb1834c-39ac-4ba9-bce1-44f7a4805a24',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 885.179822] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock port-8d48b4e8-b60d-4d20-babd-1f3a416c8a92 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.179822] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8d48b4e8-b60d-4d20-babd-1f3a416c8a92" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.179822] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8d48b4e8-b60d-4d20-babd-1f3a416c8a92" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.180857] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8d48b4e8-b60d-4d20-babd-1f3a416c8a92" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.180857] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8d48b4e8-b60d-4d20-babd-1f3a416c8a92',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 885.683246] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3bb1834c-39ac-4ba9-bce1-44f7a4805a24',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 885.683829] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-3bb1834c-39ac-4ba9-bce1-44f7a4805a24 taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.683998] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3bb1834c-39ac-4ba9-bce1-44f7a4805a24" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.684369] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8d48b4e8-b60d-4d20-babd-1f3a416c8a92 with status ACTIVE [ 885.684369] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.684586] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.684586] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.684710] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.684831] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.685027] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.685492] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.685492] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.685492] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.685492] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.685958] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.685958] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.685958] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.685958] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.689408] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.689559] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8d48b4e8-b60d-4d20-babd-1f3a416c8a92 is going to be updated. [ 885.714830] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.714830] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.714830] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.715415] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.715415] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.715415] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8d48b4e8-b60d-4d20-babd-1f3a416c8a92" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.193221] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3bb1834c-39ac-4ba9-bce1-44f7a4805a24',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 886.488253] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 23ae6942-da1d-46a7-951e-aa32b51f50d2 in Status: SUCCESS [ 886.488463] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-23ae6942-da1d-46a7-951e-aa32b51f50d2" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.488663] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-23ae6942-da1d-46a7-951e-aa32b51f50d2" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.488911] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-23ae6942-da1d-46a7-951e-aa32b51f50d2" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.489129] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.489924] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.489924] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.489924] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.489924] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.489924] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-23ae6942-da1d-46a7-951e-aa32b51f50d2" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.489924] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('23ae6942-da1d-46a7-951e-aa32b51f50d2',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 886.625662] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4e234e08-a192-4c7a-badf-3e57629854d7 in Status: SUCCESS [ 886.625963] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4e234e08-a192-4c7a-badf-3e57629854d7" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.705590] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.705775] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.705833] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.706164] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.706257] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.706323] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3bb1834c-39ac-4ba9-bce1-44f7a4805a24 is going to be created. [ 886.731799] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.732062] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.732198] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.732503] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.732631] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.744096] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3bb1834c-39ac-4ba9-bce1-44f7a4805a24 in Status: UNINITIALIZED for 2s [ 886.991666] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-23ae6942-da1d-46a7-951e-aa32b51f50d2 taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.992039] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-23ae6942-da1d-46a7-951e-aa32b51f50d2" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.992556] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-23ae6942-da1d-46a7-951e-aa32b51f50d2" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.992841] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-23ae6942-da1d-46a7-951e-aa32b51f50d2" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.993106] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.993261] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.993372] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.993566] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.993669] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.993976] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-23ae6942-da1d-46a7-951e-aa32b51f50d2" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.994039] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-23ae6942-da1d-46a7-951e-aa32b51f50d2 taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.994173] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-23ae6942-da1d-46a7-951e-aa32b51f50d2" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.994256] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-23ae6942-da1d-46a7-951e-aa32b51f50d2" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.994409] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-23ae6942-da1d-46a7-951e-aa32b51f50d2" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.994561] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.994692] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.994762] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.994909] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.994989] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.995323] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-23ae6942-da1d-46a7-951e-aa32b51f50d2" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.995516] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('23ae6942-da1d-46a7-951e-aa32b51f50d2',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 887.232218] env[65306]: INFO networking_nsxv3.common.synchronization [None req-e131225d-3082-486e-8d21-acede0c5b6fa None None] Enqueued Resource ID: 13db0656-53fc-435d-8cd3-1719e072696c with Priority: HIGHEST for action port [ 887.233435] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 13db0656-53fc-435d-8cd3-1719e072696c with Priority: HIGHEST for action port [ 887.233435] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock port-13db0656-53fc-435d-8cd3-1719e072696c taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.235927] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-13db0656-53fc-435d-8cd3-1719e072696c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.236282] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-13db0656-53fc-435d-8cd3-1719e072696c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.236492] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-13db0656-53fc-435d-8cd3-1719e072696c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.237028] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('13db0656-53fc-435d-8cd3-1719e072696c',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 887.498437] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 23ae6942-da1d-46a7-951e-aa32b51f50d2: rpc.has_security_group_logging(os_id): False [ 887.517332] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.517487] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.517487] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.517625] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.517721] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.517926] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.518038] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.518103] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.518258] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.518336] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.518508] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.518717] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.518717] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.518849] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.518849] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.519070] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.519164] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.519243] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.519342] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.519417] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.519505] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 23ae6942-da1d-46a7-951e-aa32b51f50d2 is going to be created. [ 887.591431] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.591578] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.591651] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.591864] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.592087] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.607195] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 23ae6942-da1d-46a7-951e-aa32b51f50d2 in Status: IN_PROGRESS for 2s [ 887.741296] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 13db0656-53fc-435d-8cd3-1719e072696c [ 887.742088] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.742281] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.742422] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.742577] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.742670] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.742772] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:13db0656-53fc-435d-8cd3-1719e072696c already deleted. [ 887.742869] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-13db0656-53fc-435d-8cd3-1719e072696c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.280678] env[65306]: INFO networking_nsxv3.common.synchronization [req-ec2e4da8-a5e8-4c38-a58e-2f39f7c6b634 req-02863e11-56ce-4e78-ae10-e5a1d9815c75 tempest-InstanceActionsV221TestJSON-172623164 tempest-InstanceActionsV221TestJSON-172623164-project-member] Enqueued Resource ID: 563b7655-db8f-408d-8ce8-bfec6b58c669 with Priority: HIGHEST for action security_group_members [ 888.281339] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 563b7655-db8f-408d-8ce8-bfec6b58c669 with Priority: HIGHEST for action security_group_members [ 888.281661] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-563b7655-db8f-408d-8ce8-bfec6b58c669 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.281780] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-563b7655-db8f-408d-8ce8-bfec6b58c669" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.281860] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-563b7655-db8f-408d-8ce8-bfec6b58c669" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.283091] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-563b7655-db8f-408d-8ce8-bfec6b58c669" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.283334] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.283494] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.283564] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.283862] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.283862] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.283961] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('563b7655-db8f-408d-8ce8-bfec6b58c669',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 888.758031] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3bb1834c-39ac-4ba9-bce1-44f7a4805a24 in Status: SUCCESS [ 888.758031] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3bb1834c-39ac-4ba9-bce1-44f7a4805a24" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.758031] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3bb1834c-39ac-4ba9-bce1-44f7a4805a24" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.758031] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3bb1834c-39ac-4ba9-bce1-44f7a4805a24" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.758031] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.758031] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.758031] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.758031] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.758031] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.758031] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3bb1834c-39ac-4ba9-bce1-44f7a4805a24" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.758031] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3bb1834c-39ac-4ba9-bce1-44f7a4805a24',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 888.789398] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.789398] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.789398] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.789398] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.789398] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.789398] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.789398] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.789398] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.789398] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.789778] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.789778] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 563b7655-db8f-408d-8ce8-bfec6b58c669 already deleted. [ 888.789778] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-563b7655-db8f-408d-8ce8-bfec6b58c669" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.090280] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock network-150 taken with stack trace [, , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.090693] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "network-150" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.091053] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "network-150" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.091511] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "network-150" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.091889] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.094871] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.094871] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.094871] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.094871] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.094871] env[65306]: DEBUG dogpile.cache.region [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] No value present for key: 'zone-id' {{(pid=65306) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 889.094871] env[65306]: DEBUG dogpile.lock [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] NeedRegenerationException {{(pid=65306) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 889.094871] env[65306]: DEBUG dogpile.lock [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] no value, waiting for create lock {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 889.094871] env[65306]: DEBUG dogpile.lock [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] value creation lock acquired {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 889.094871] env[65306]: DEBUG dogpile.cache.region [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] No value present for key: 'zone-id' {{(pid=65306) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 889.094871] env[65306]: DEBUG dogpile.lock [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Calling creation function for not-yet-present value {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 889.094871] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 889.115438] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 889.115647] env[65306]: DEBUG dogpile.cache.region [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65306) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 889.115789] env[65306]: DEBUG dogpile.lock [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Released creation lock {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 889.115980] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "network-150" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.116334] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock port-1ec1a1c9-0bc6-4c05-9f14-0138cf48c0dd taken with stack trace [, , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.116510] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "port-1ec1a1c9-0bc6-4c05-9f14-0138cf48c0dd" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.116630] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "port-1ec1a1c9-0bc6-4c05-9f14-0138cf48c0dd" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.116936] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "port-1ec1a1c9-0bc6-4c05-9f14-0138cf48c0dd" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.117092] env[65306]: DEBUG networking_nsxv3.api.rpc [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1ec1a1c9-0bc6-4c05-9f14-0138cf48c0dd',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 889.186468] env[65306]: INFO networking_nsxv3.common.synchronization [req-697b451b-8c0b-49cf-83c8-9d4b11b9ead9 req-d17096e7-0c84-4943-bac9-27abf5fb199b tempest-ServersTestJSON-1200400240 tempest-ServersTestJSON-1200400240-project-member] Enqueued Resource ID: c90bbe47-7f68-400a-a228-2030ba9cad31 with Priority: HIGHEST for action security_group_members [ 889.187379] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c90bbe47-7f68-400a-a228-2030ba9cad31 with Priority: HIGHEST for action security_group_members [ 889.187484] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-c90bbe47-7f68-400a-a228-2030ba9cad31 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.187575] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c90bbe47-7f68-400a-a228-2030ba9cad31" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.187633] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c90bbe47-7f68-400a-a228-2030ba9cad31" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.188669] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c90bbe47-7f68-400a-a228-2030ba9cad31" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.188872] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.189036] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.189100] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.189286] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.189415] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.189546] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c90bbe47-7f68-400a-a228-2030ba9cad31',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 889.264036] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3bb1834c-39ac-4ba9-bce1-44f7a4805a24',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 889.557905] env[65306]: INFO networking_nsxv3.common.synchronization [None req-60dd71ad-38ec-4026-ba0c-b9477bf12d51 None None] Enqueued Resource ID: fd91abe4-6cb9-4b31-b0b2-b06d1f771dc2 with Priority: HIGHEST for action port [ 889.558644] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fd91abe4-6cb9-4b31-b0b2-b06d1f771dc2 with Priority: HIGHEST for action port [ 889.558819] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock port-fd91abe4-6cb9-4b31-b0b2-b06d1f771dc2 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.558966] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fd91abe4-6cb9-4b31-b0b2-b06d1f771dc2" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.559051] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fd91abe4-6cb9-4b31-b0b2-b06d1f771dc2" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.559476] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fd91abe4-6cb9-4b31-b0b2-b06d1f771dc2" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.559476] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fd91abe4-6cb9-4b31-b0b2-b06d1f771dc2',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 889.620028] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.620028] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.620028] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.620320] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.620476] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.620650] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Segment Port 1ec1a1c9-0bc6-4c05-9f14-0138cf48c0dd not found, creating... [ 889.620988] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.621192] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.621311] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.621544] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.621681] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.622125] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.622392] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.622630] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.624041] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.624041] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.624041] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Resource: SegmentPort with ID: 1ec1a1c9-0bc6-4c05-9f14-0138cf48c0dd is going to be created. [ 889.625858] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 23ae6942-da1d-46a7-951e-aa32b51f50d2 in Status: SUCCESS [ 889.625858] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-23ae6942-da1d-46a7-951e-aa32b51f50d2" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.651733] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.651733] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.651733] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.651733] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.651733] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.651733] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "port-1ec1a1c9-0bc6-4c05-9f14-0138cf48c0dd" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.691612] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.691735] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.691810] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.692039] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.723526] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.723951] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.724177] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.724308] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.724621] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.724774] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.724929] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c90bbe47-7f68-400a-a228-2030ba9cad31 is going to be updated. [ 889.762173] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.762416] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.762500] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.763069] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.763322] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.765687] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3bb1834c-39ac-4ba9-bce1-44f7a4805a24: rpc.has_security_group_logging(os_id): False [ 889.778682] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c90bbe47-7f68-400a-a228-2030ba9cad31 in Status: IN_PROGRESS for 2s [ 889.794913] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.795122] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.796237] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.796237] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.796237] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.796237] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.796237] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.796237] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.796496] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.796496] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.796582] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3bb1834c-39ac-4ba9-bce1-44f7a4805a24 is going to be created. [ 889.882380] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.884738] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.884738] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.884738] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.884738] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.910613] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3bb1834c-39ac-4ba9-bce1-44f7a4805a24 in Status: IN_PROGRESS for 2s [ 890.067522] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port fd91abe4-6cb9-4b31-b0b2-b06d1f771dc2 [ 890.067522] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.067522] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.067522] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.067522] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.067522] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.067522] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:fd91abe4-6cb9-4b31-b0b2-b06d1f771dc2 already deleted. [ 890.067522] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fd91abe4-6cb9-4b31-b0b2-b06d1f771dc2" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.466614] env[65306]: INFO networking_nsxv3.common.synchronization [req-ec2e4da8-a5e8-4c38-a58e-2f39f7c6b634 req-614c72f8-f178-4783-8bf3-a895efec5352 service nova] Enqueued Resource ID: 563b7655-db8f-408d-8ce8-bfec6b58c669 with Priority: HIGHEST for action security_group_rules [ 890.468564] env[65306]: INFO networking_nsxv3.common.synchronization [req-ec2e4da8-a5e8-4c38-a58e-2f39f7c6b634 req-614c72f8-f178-4783-8bf3-a895efec5352 service nova] Enqueued Resource ID: 563b7655-db8f-408d-8ce8-bfec6b58c669 with Priority: HIGHEST for action security_group_members [ 890.471467] env[65306]: INFO networking_nsxv3.common.synchronization [req-ec2e4da8-a5e8-4c38-a58e-2f39f7c6b634 req-614c72f8-f178-4783-8bf3-a895efec5352 service nova] Enqueued Resource ID: 1ec1a1c9-0bc6-4c05-9f14-0138cf48c0dd with Priority: HIGHEST for action port [ 890.472332] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 563b7655-db8f-408d-8ce8-bfec6b58c669 with Priority: HIGHEST for action security_group_rules [ 890.472773] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 563b7655-db8f-408d-8ce8-bfec6b58c669 with Priority: HIGHEST for action security_group_members [ 890.472773] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1ec1a1c9-0bc6-4c05-9f14-0138cf48c0dd with Priority: HIGHEST for action port [ 890.473327] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock rules-563b7655-db8f-408d-8ce8-bfec6b58c669 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.473401] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-563b7655-db8f-408d-8ce8-bfec6b58c669" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.474111] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-563b7655-db8f-408d-8ce8-bfec6b58c669" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.474111] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-563b7655-db8f-408d-8ce8-bfec6b58c669" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.474440] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('563b7655-db8f-408d-8ce8-bfec6b58c669',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 890.475913] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-563b7655-db8f-408d-8ce8-bfec6b58c669 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.476053] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-563b7655-db8f-408d-8ce8-bfec6b58c669" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.476833] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-563b7655-db8f-408d-8ce8-bfec6b58c669" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.476833] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-563b7655-db8f-408d-8ce8-bfec6b58c669" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.476833] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.476833] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.476833] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.477074] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.477181] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.477344] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('563b7655-db8f-408d-8ce8-bfec6b58c669',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 890.481045] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock port-1ec1a1c9-0bc6-4c05-9f14-0138cf48c0dd taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.481045] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1ec1a1c9-0bc6-4c05-9f14-0138cf48c0dd" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.481045] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1ec1a1c9-0bc6-4c05-9f14-0138cf48c0dd" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.481255] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1ec1a1c9-0bc6-4c05-9f14-0138cf48c0dd" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.481255] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1ec1a1c9-0bc6-4c05-9f14-0138cf48c0dd',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 890.750727] env[65306]: INFO networking_nsxv3.common.synchronization [None req-404f0ba8-1dea-4fb3-84ed-78c0ad634b28 None None] Enqueued Resource ID: b691d4a3-06f3-4c15-aacf-c559bc896da1 with Priority: HIGHEST for action port [ 890.751363] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b691d4a3-06f3-4c15-aacf-c559bc896da1 with Priority: HIGHEST for action port [ 890.751659] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock port-b691d4a3-06f3-4c15-aacf-c559bc896da1 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.751791] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b691d4a3-06f3-4c15-aacf-c559bc896da1" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.751885] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b691d4a3-06f3-4c15-aacf-c559bc896da1" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.754266] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b691d4a3-06f3-4c15-aacf-c559bc896da1" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.754353] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b691d4a3-06f3-4c15-aacf-c559bc896da1',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 890.984542] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('563b7655-db8f-408d-8ce8-bfec6b58c669',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 890.987771] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-563b7655-db8f-408d-8ce8-bfec6b58c669 taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.987931] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-563b7655-db8f-408d-8ce8-bfec6b58c669" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.988184] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1ec1a1c9-0bc6-4c05-9f14-0138cf48c0dd with status ACTIVE [ 890.988325] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.988454] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.988524] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.988724] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.988861] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.989070] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.989174] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.989232] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.989396] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.990313] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.990313] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.990313] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.990313] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.990313] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.990720] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.990720] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1ec1a1c9-0bc6-4c05-9f14-0138cf48c0dd is going to be updated. [ 891.015807] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.016070] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.016189] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.017240] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.017402] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.017580] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1ec1a1c9-0bc6-4c05-9f14-0138cf48c0dd" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.035409] env[65306]: INFO networking_nsxv3.common.synchronization [req-7b357d22-13b7-4cc9-9c22-a27ee3d85f90 req-e67df38c-725b-4f8e-b404-4702d4c06ad8 tempest-ServersNegativeTestMultiTenantJSON-433533185 tempest-ServersNegativeTestMultiTenantJSON-433533185-project-member] Enqueued Resource ID: 2cdaf88a-80a7-4019-9156-d7e0483af77f with Priority: HIGHEST for action security_group_members [ 891.035965] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2cdaf88a-80a7-4019-9156-d7e0483af77f with Priority: HIGHEST for action security_group_members [ 891.036294] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-2cdaf88a-80a7-4019-9156-d7e0483af77f taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.036408] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2cdaf88a-80a7-4019-9156-d7e0483af77f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.036481] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2cdaf88a-80a7-4019-9156-d7e0483af77f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.036732] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2cdaf88a-80a7-4019-9156-d7e0483af77f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.036877] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.036978] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.037123] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.037315] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.037434] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.037556] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2cdaf88a-80a7-4019-9156-d7e0483af77f',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 891.259825] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b691d4a3-06f3-4c15-aacf-c559bc896da1 [ 891.259825] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.259825] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.259825] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.259825] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.259825] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.259825] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b691d4a3-06f3-4c15-aacf-c559bc896da1 already deleted. [ 891.259825] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b691d4a3-06f3-4c15-aacf-c559bc896da1" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.492855] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('563b7655-db8f-408d-8ce8-bfec6b58c669',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 891.542499] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.542651] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.542726] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.543029] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.543029] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.544369] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.544369] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.544369] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.544369] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.544369] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.544369] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2cdaf88a-80a7-4019-9156-d7e0483af77f already deleted. [ 891.544369] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2cdaf88a-80a7-4019-9156-d7e0483af77f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.639249] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock network-841 taken with stack trace [, , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.639465] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "network-841" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.640198] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "network-841" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.640198] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "network-841" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.640198] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.640369] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.640905] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.640905] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.640905] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.641043] env[65306]: DEBUG dogpile.cache.region [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] No value present for key: 'zone-id' {{(pid=65306) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 891.641163] env[65306]: DEBUG dogpile.lock [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] NeedRegenerationException {{(pid=65306) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 891.641270] env[65306]: DEBUG dogpile.lock [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] no value, waiting for create lock {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 891.641467] env[65306]: DEBUG dogpile.lock [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] value creation lock acquired {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 891.641585] env[65306]: DEBUG dogpile.cache.region [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] No value present for key: 'zone-id' {{(pid=65306) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 891.641690] env[65306]: DEBUG dogpile.lock [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Calling creation function for not-yet-present value {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 891.641824] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 891.663609] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 891.663776] env[65306]: DEBUG dogpile.cache.region [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65306) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 891.663920] env[65306]: DEBUG dogpile.lock [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Released creation lock {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 891.664121] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "network-841" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.665360] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock port-81431615-3f55-4d4b-8ee0-ec15abf3875a taken with stack trace [, , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.665360] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "port-81431615-3f55-4d4b-8ee0-ec15abf3875a" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.665360] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "port-81431615-3f55-4d4b-8ee0-ec15abf3875a" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.665360] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "port-81431615-3f55-4d4b-8ee0-ec15abf3875a" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.665360] env[65306]: DEBUG networking_nsxv3.api.rpc [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('81431615-3f55-4d4b-8ee0-ec15abf3875a',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 891.788906] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c90bbe47-7f68-400a-a228-2030ba9cad31 in Status: SUCCESS [ 891.789244] env[65306]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c90bbe47-7f68-400a-a228-2030ba9cad31 deletion is rescheduled due to dependency. [ 891.790215] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c90bbe47-7f68-400a-a228-2030ba9cad31" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.926739] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3bb1834c-39ac-4ba9-bce1-44f7a4805a24 in Status: SUCCESS [ 891.926739] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3bb1834c-39ac-4ba9-bce1-44f7a4805a24" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.967516] env[65306]: INFO networking_nsxv3.common.synchronization [None req-9c3b3a3f-ba6e-4e4e-b31f-1898e964510e None None] Enqueued Resource ID: b85652c8-99d1-4d65-b6b9-c586925dea2f with Priority: HIGHEST for action port [ 891.968105] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b85652c8-99d1-4d65-b6b9-c586925dea2f with Priority: HIGHEST for action port [ 891.968418] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock port-b85652c8-99d1-4d65-b6b9-c586925dea2f taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.968542] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b85652c8-99d1-4d65-b6b9-c586925dea2f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.968638] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b85652c8-99d1-4d65-b6b9-c586925dea2f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.968873] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b85652c8-99d1-4d65-b6b9-c586925dea2f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.969817] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b85652c8-99d1-4d65-b6b9-c586925dea2f',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 891.995134] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.995288] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.995362] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.995574] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.995671] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.995771] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 563b7655-db8f-408d-8ce8-bfec6b58c669 is going to be created. [ 892.020981] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.021206] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.021206] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.021436] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.021602] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.032403] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 563b7655-db8f-408d-8ce8-bfec6b58c669 in Status: UNINITIALIZED for 2s [ 892.171943] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.172672] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.172672] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.172791] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.172959] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.173205] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Segment Port 81431615-3f55-4d4b-8ee0-ec15abf3875a not found, creating... [ 892.173578] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.173781] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.173919] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.174200] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.174355] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.174668] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.174840] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.175039] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.175326] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.175486] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.175650] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Resource: SegmentPort with ID: 81431615-3f55-4d4b-8ee0-ec15abf3875a is going to be created. [ 892.198591] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.198905] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.198983] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.199404] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.199688] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.200241] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "port-81431615-3f55-4d4b-8ee0-ec15abf3875a" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.371546] env[65306]: INFO networking_nsxv3.common.synchronization [None req-9d1b5b5d-0347-4936-8175-c479d7b9363c None None] Enqueued Resource ID: e05cb794-2102-49bf-8075-208ea5b845e3 with Priority: HIGHEST for action port [ 892.372267] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e05cb794-2102-49bf-8075-208ea5b845e3 with Priority: HIGHEST for action port [ 892.372654] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock port-e05cb794-2102-49bf-8075-208ea5b845e3 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.373245] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e05cb794-2102-49bf-8075-208ea5b845e3" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.373245] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e05cb794-2102-49bf-8075-208ea5b845e3" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.373245] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e05cb794-2102-49bf-8075-208ea5b845e3" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.373376] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e05cb794-2102-49bf-8075-208ea5b845e3',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 892.473350] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b85652c8-99d1-4d65-b6b9-c586925dea2f [ 892.474386] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.474386] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.474386] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.474386] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.474386] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.474386] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b85652c8-99d1-4d65-b6b9-c586925dea2f already deleted. [ 892.474386] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b85652c8-99d1-4d65-b6b9-c586925dea2f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.876615] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e05cb794-2102-49bf-8075-208ea5b845e3 [ 892.876973] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.877526] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.877526] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.877526] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.877526] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.877526] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e05cb794-2102-49bf-8075-208ea5b845e3 already deleted. [ 892.877744] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e05cb794-2102-49bf-8075-208ea5b845e3" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.907077] env[65306]: INFO networking_nsxv3.common.synchronization [req-7b357d22-13b7-4cc9-9c22-a27ee3d85f90 req-3dc5fb6c-9c92-4ae0-bcab-ef41c333f024 service nova] Enqueued Resource ID: 2cdaf88a-80a7-4019-9156-d7e0483af77f with Priority: HIGHEST for action security_group_rules [ 892.907264] env[65306]: INFO networking_nsxv3.common.synchronization [req-7b357d22-13b7-4cc9-9c22-a27ee3d85f90 req-3dc5fb6c-9c92-4ae0-bcab-ef41c333f024 service nova] Enqueued Resource ID: 2cdaf88a-80a7-4019-9156-d7e0483af77f with Priority: HIGHEST for action security_group_members [ 892.907402] env[65306]: INFO networking_nsxv3.common.synchronization [req-7b357d22-13b7-4cc9-9c22-a27ee3d85f90 req-3dc5fb6c-9c92-4ae0-bcab-ef41c333f024 service nova] Enqueued Resource ID: 81431615-3f55-4d4b-8ee0-ec15abf3875a with Priority: HIGHEST for action port [ 892.907720] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2cdaf88a-80a7-4019-9156-d7e0483af77f with Priority: HIGHEST for action security_group_rules [ 892.907781] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2cdaf88a-80a7-4019-9156-d7e0483af77f with Priority: HIGHEST for action security_group_members [ 892.907848] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 81431615-3f55-4d4b-8ee0-ec15abf3875a with Priority: HIGHEST for action port [ 892.908410] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2cdaf88a-80a7-4019-9156-d7e0483af77f taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.908540] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2cdaf88a-80a7-4019-9156-d7e0483af77f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.908588] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2cdaf88a-80a7-4019-9156-d7e0483af77f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.908838] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2cdaf88a-80a7-4019-9156-d7e0483af77f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.908922] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2cdaf88a-80a7-4019-9156-d7e0483af77f',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 892.909988] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-2cdaf88a-80a7-4019-9156-d7e0483af77f taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.909988] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2cdaf88a-80a7-4019-9156-d7e0483af77f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.909988] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2cdaf88a-80a7-4019-9156-d7e0483af77f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.910176] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2cdaf88a-80a7-4019-9156-d7e0483af77f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.910316] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.910413] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.910475] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.910611] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.910693] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.910822] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2cdaf88a-80a7-4019-9156-d7e0483af77f',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 892.911914] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock port-81431615-3f55-4d4b-8ee0-ec15abf3875a taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.912081] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-81431615-3f55-4d4b-8ee0-ec15abf3875a" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.912124] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-81431615-3f55-4d4b-8ee0-ec15abf3875a" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.912306] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-81431615-3f55-4d4b-8ee0-ec15abf3875a" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.912384] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('81431615-3f55-4d4b-8ee0-ec15abf3875a',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 893.418341] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2cdaf88a-80a7-4019-9156-d7e0483af77f',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 893.418341] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-2cdaf88a-80a7-4019-9156-d7e0483af77f taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.418341] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2cdaf88a-80a7-4019-9156-d7e0483af77f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.418341] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 81431615-3f55-4d4b-8ee0-ec15abf3875a with status ACTIVE [ 893.418341] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.418341] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.418341] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.418341] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.418341] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.418341] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.418341] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.418341] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.419029] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.419029] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.419029] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.419029] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.419029] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.419368] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.419594] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.419732] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 81431615-3f55-4d4b-8ee0-ec15abf3875a is going to be updated. [ 893.448522] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.448522] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.448522] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.448522] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.448522] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.448522] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-81431615-3f55-4d4b-8ee0-ec15abf3875a" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.453415] env[65306]: INFO networking_nsxv3.common.synchronization [req-9fbffa88-b1bf-47a8-918f-19f3f656dea4 req-6a05efd6-abcb-4247-ab9b-c27e7a75c8e8 tempest-ServersAdminTestJSON-2076938379 tempest-ServersAdminTestJSON-2076938379-project-member] Enqueued Resource ID: 56904b3c-38e4-4547-9a1d-cc787c3fef9d with Priority: HIGHEST for action security_group_members [ 893.453687] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 56904b3c-38e4-4547-9a1d-cc787c3fef9d with Priority: HIGHEST for action security_group_members [ 893.454047] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-56904b3c-38e4-4547-9a1d-cc787c3fef9d taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.454176] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-56904b3c-38e4-4547-9a1d-cc787c3fef9d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.454251] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-56904b3c-38e4-4547-9a1d-cc787c3fef9d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.454458] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-56904b3c-38e4-4547-9a1d-cc787c3fef9d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.454620] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.454722] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.454788] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.454937] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.457738] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.457916] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('56904b3c-38e4-4547-9a1d-cc787c3fef9d',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 893.834392] env[65306]: INFO networking_nsxv3.common.synchronization [None req-7b5a9e6e-1a03-4f0e-80b1-8ce5dc611e19 tempest-AttachVolumeTestJSON-1277615836 tempest-AttachVolumeTestJSON-1277615836-project-member] Enqueued Resource ID: 331be455-1cf8-4667-8d43-bd7a51712610 with Priority: HIGHEST for action security_group_rules [ 893.835720] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 331be455-1cf8-4667-8d43-bd7a51712610 with Priority: HIGHEST for action security_group_rules [ 893.836890] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock network-705 taken with stack trace [, , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.836986] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "network-705" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.838400] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "network-705" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.838400] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "network-705" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.838400] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.838400] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.838400] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.838861] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.838861] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.838861] env[65306]: DEBUG dogpile.cache.region [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] No value present for key: 'zone-id' {{(pid=65306) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 893.840453] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] NeedRegenerationException {{(pid=65306) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 893.840453] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] no value, waiting for create lock {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 893.840453] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] value creation lock acquired {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 893.840453] env[65306]: DEBUG dogpile.cache.region [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] No value present for key: 'zone-id' {{(pid=65306) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 893.840453] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Calling creation function for not-yet-present value {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 893.840453] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 893.841020] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock rules-331be455-1cf8-4667-8d43-bd7a51712610 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.841155] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-331be455-1cf8-4667-8d43-bd7a51712610" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.841225] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-331be455-1cf8-4667-8d43-bd7a51712610" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.841480] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-331be455-1cf8-4667-8d43-bd7a51712610" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.841582] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('331be455-1cf8-4667-8d43-bd7a51712610',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 893.864597] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 893.864597] env[65306]: DEBUG dogpile.cache.region [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65306) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 893.864597] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Released creation lock {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 893.864773] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "network-705" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.865011] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock port-6c66be3e-3e32-48ef-a2a5-ffb63a76a257 taken with stack trace [, , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.865230] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "port-6c66be3e-3e32-48ef-a2a5-ffb63a76a257" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.865352] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "port-6c66be3e-3e32-48ef-a2a5-ffb63a76a257" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.865780] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "port-6c66be3e-3e32-48ef-a2a5-ffb63a76a257" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.866014] env[65306]: DEBUG networking_nsxv3.api.rpc [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6c66be3e-3e32-48ef-a2a5-ffb63a76a257',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 893.924695] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2cdaf88a-80a7-4019-9156-d7e0483af77f',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 893.961612] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('56904b3c-38e4-4547-9a1d-cc787c3fef9d',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 894.044027] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 563b7655-db8f-408d-8ce8-bfec6b58c669 in Status: SUCCESS [ 894.044027] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-563b7655-db8f-408d-8ce8-bfec6b58c669" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.044027] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-563b7655-db8f-408d-8ce8-bfec6b58c669" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.044267] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-563b7655-db8f-408d-8ce8-bfec6b58c669" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.044866] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.044866] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.044866] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.044866] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.045130] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.045130] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-563b7655-db8f-408d-8ce8-bfec6b58c669" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.045130] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('563b7655-db8f-408d-8ce8-bfec6b58c669',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 894.084242] env[65306]: INFO networking_nsxv3.common.synchronization [None req-9edc69aa-59db-4c27-9f9f-a2367d06785f tempest-AttachVolumeTestJSON-1277615836 tempest-AttachVolumeTestJSON-1277615836-project-member] Enqueued Resource ID: 331be455-1cf8-4667-8d43-bd7a51712610 with Priority: HIGHEST for action security_group_rules [ 894.084814] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 331be455-1cf8-4667-8d43-bd7a51712610 with Priority: HIGHEST for action security_group_rules [ 894.085389] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock rules-331be455-1cf8-4667-8d43-bd7a51712610 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.085389] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-331be455-1cf8-4667-8d43-bd7a51712610" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.357942] env[65306]: INFO networking_nsxv3.common.synchronization [None req-3118b83a-97b9-4518-8afe-5e1d143271e3 tempest-AttachInterfacesTestJSON-144464476 tempest-AttachInterfacesTestJSON-144464476-project-member] Enqueued Resource ID: 50a889c1-6336-4320-94ea-df1e6eaa778c with Priority: HIGHEST for action security_group_rules [ 894.358495] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 50a889c1-6336-4320-94ea-df1e6eaa778c with Priority: HIGHEST for action security_group_rules [ 894.358822] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock rules-50a889c1-6336-4320-94ea-df1e6eaa778c taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.359025] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-50a889c1-6336-4320-94ea-df1e6eaa778c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.359025] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-50a889c1-6336-4320-94ea-df1e6eaa778c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.359286] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-50a889c1-6336-4320-94ea-df1e6eaa778c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.359384] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('50a889c1-6336-4320-94ea-df1e6eaa778c',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 894.364855] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.364981] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.365064] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.365265] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.365354] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.365445] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 331be455-1cf8-4667-8d43-bd7a51712610 already deleted. [ 894.365530] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-331be455-1cf8-4667-8d43-bd7a51712610" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.366293] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-331be455-1cf8-4667-8d43-bd7a51712610" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.366293] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-331be455-1cf8-4667-8d43-bd7a51712610" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.366293] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('331be455-1cf8-4667-8d43-bd7a51712610',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 894.368786] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.369014] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.369149] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.369377] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.369520] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.370107] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Segment Port 6c66be3e-3e32-48ef-a2a5-ffb63a76a257 not found, creating... [ 894.370107] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.370538] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.370725] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.370898] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.371067] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.371349] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.371532] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.371661] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.371994] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.372148] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.372346] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Resource: SegmentPort with ID: 6c66be3e-3e32-48ef-a2a5-ffb63a76a257 is going to be created. [ 894.392958] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.393222] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.393338] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.393614] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.393845] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.394500] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "port-6c66be3e-3e32-48ef-a2a5-ffb63a76a257" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.429055] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.429241] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.429310] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.429541] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.429624] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.429734] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2cdaf88a-80a7-4019-9156-d7e0483af77f is going to be created. [ 894.460930] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.460930] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.460930] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.461504] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.461504] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.464160] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('56904b3c-38e4-4547-9a1d-cc787c3fef9d',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 894.473554] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2cdaf88a-80a7-4019-9156-d7e0483af77f in Status: UNINITIALIZED for 2s [ 894.548427] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-563b7655-db8f-408d-8ce8-bfec6b58c669 taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.548427] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-563b7655-db8f-408d-8ce8-bfec6b58c669" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.548427] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-563b7655-db8f-408d-8ce8-bfec6b58c669" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.548827] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-563b7655-db8f-408d-8ce8-bfec6b58c669" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.548827] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.548827] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.548940] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.551498] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.551498] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.551498] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-563b7655-db8f-408d-8ce8-bfec6b58c669" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.551498] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-563b7655-db8f-408d-8ce8-bfec6b58c669 taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.551498] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-563b7655-db8f-408d-8ce8-bfec6b58c669" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.551498] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-563b7655-db8f-408d-8ce8-bfec6b58c669" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.551498] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-563b7655-db8f-408d-8ce8-bfec6b58c669" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.551498] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.551498] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.551498] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.551498] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.551498] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.551498] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-563b7655-db8f-408d-8ce8-bfec6b58c669" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.551498] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('563b7655-db8f-408d-8ce8-bfec6b58c669',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 894.887593] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.887971] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.887971] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.887971] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.888098] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.888183] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 50a889c1-6336-4320-94ea-df1e6eaa778c already deleted. [ 894.888278] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-50a889c1-6336-4320-94ea-df1e6eaa778c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.892457] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.892635] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.892635] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.892868] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.892964] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.893081] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 331be455-1cf8-4667-8d43-bd7a51712610 already deleted. [ 894.893138] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-331be455-1cf8-4667-8d43-bd7a51712610" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.910337] env[65306]: INFO networking_nsxv3.common.synchronization [None req-0dbfbedc-8362-465c-abfa-28f15de681e9 tempest-AttachInterfacesTestJSON-144464476 tempest-AttachInterfacesTestJSON-144464476-project-member] Enqueued Resource ID: 50a889c1-6336-4320-94ea-df1e6eaa778c with Priority: HIGHEST for action security_group_rules [ 894.910943] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 50a889c1-6336-4320-94ea-df1e6eaa778c with Priority: HIGHEST for action security_group_rules [ 894.911290] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock rules-50a889c1-6336-4320-94ea-df1e6eaa778c taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.911418] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-50a889c1-6336-4320-94ea-df1e6eaa778c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.911485] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-50a889c1-6336-4320-94ea-df1e6eaa778c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.911685] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-50a889c1-6336-4320-94ea-df1e6eaa778c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.911773] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('50a889c1-6336-4320-94ea-df1e6eaa778c',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 894.941582] env[65306]: INFO networking_nsxv3.common.synchronization [None req-1171f3cf-0060-4d7b-9f23-6f0dc0a35cb8 None None] Enqueued Resource ID: 4bed98c1-af24-4a10-871b-c74b7577b4c9 with Priority: HIGHEST for action port [ 894.943332] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4bed98c1-af24-4a10-871b-c74b7577b4c9 with Priority: HIGHEST for action port [ 894.944036] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock port-4bed98c1-af24-4a10-871b-c74b7577b4c9 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.944036] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4bed98c1-af24-4a10-871b-c74b7577b4c9" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.944036] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4bed98c1-af24-4a10-871b-c74b7577b4c9" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.944207] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4bed98c1-af24-4a10-871b-c74b7577b4c9" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.944299] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4bed98c1-af24-4a10-871b-c74b7577b4c9',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 894.967489] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.967666] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.967706] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.967896] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.967984] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.968098] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 56904b3c-38e4-4547-9a1d-cc787c3fef9d is going to be updated. [ 895.011204] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.011716] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.011799] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.012059] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.012248] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.024800] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 56904b3c-38e4-4547-9a1d-cc787c3fef9d in Status: IN_PROGRESS for 2s [ 895.054680] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 563b7655-db8f-408d-8ce8-bfec6b58c669: rpc.has_security_group_logging(os_id): False [ 895.079996] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.080191] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.080298] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.081358] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.081446] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.082259] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.082259] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.082259] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.082259] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.082490] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.082557] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.082695] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.082832] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.082999] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.083119] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.083359] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.083490] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.083579] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.083766] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.083876] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.083994] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 563b7655-db8f-408d-8ce8-bfec6b58c669 is going to be created. [ 895.161167] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.161861] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.161968] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.162467] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.162682] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.175060] env[65306]: INFO networking_nsxv3.common.synchronization [req-9fbffa88-b1bf-47a8-918f-19f3f656dea4 req-9a25dac5-be64-46ab-973c-7fc4ff172edb service nova] Enqueued Resource ID: 56904b3c-38e4-4547-9a1d-cc787c3fef9d with Priority: HIGHEST for action security_group_rules [ 895.175214] env[65306]: INFO networking_nsxv3.common.synchronization [req-9fbffa88-b1bf-47a8-918f-19f3f656dea4 req-9a25dac5-be64-46ab-973c-7fc4ff172edb service nova] Enqueued Resource ID: 56904b3c-38e4-4547-9a1d-cc787c3fef9d with Priority: HIGHEST for action security_group_members [ 895.175465] env[65306]: INFO networking_nsxv3.common.synchronization [req-9fbffa88-b1bf-47a8-918f-19f3f656dea4 req-9a25dac5-be64-46ab-973c-7fc4ff172edb service nova] Enqueued Resource ID: 6c66be3e-3e32-48ef-a2a5-ffb63a76a257 with Priority: HIGHEST for action port [ 895.176468] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 56904b3c-38e4-4547-9a1d-cc787c3fef9d with Priority: HIGHEST for action security_group_rules [ 895.176683] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 56904b3c-38e4-4547-9a1d-cc787c3fef9d with Priority: HIGHEST for action security_group_members [ 895.176856] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6c66be3e-3e32-48ef-a2a5-ffb63a76a257 with Priority: HIGHEST for action port [ 895.177532] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock rules-56904b3c-38e4-4547-9a1d-cc787c3fef9d taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.178635] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-56904b3c-38e4-4547-9a1d-cc787c3fef9d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.178779] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-56904b3c-38e4-4547-9a1d-cc787c3fef9d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.179086] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-56904b3c-38e4-4547-9a1d-cc787c3fef9d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.179249] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('56904b3c-38e4-4547-9a1d-cc787c3fef9d',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 895.182225] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-56904b3c-38e4-4547-9a1d-cc787c3fef9d taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.182369] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-56904b3c-38e4-4547-9a1d-cc787c3fef9d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.183037] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock port-6c66be3e-3e32-48ef-a2a5-ffb63a76a257 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.183037] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6c66be3e-3e32-48ef-a2a5-ffb63a76a257" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.183037] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6c66be3e-3e32-48ef-a2a5-ffb63a76a257" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.183037] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6c66be3e-3e32-48ef-a2a5-ffb63a76a257" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.183334] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6c66be3e-3e32-48ef-a2a5-ffb63a76a257',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 895.186333] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 563b7655-db8f-408d-8ce8-bfec6b58c669 in Status: IN_PROGRESS for 2s [ 895.443553] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.443685] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.443764] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.443983] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.444092] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.444191] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 50a889c1-6336-4320-94ea-df1e6eaa778c already deleted. [ 895.444275] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-50a889c1-6336-4320-94ea-df1e6eaa778c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.446344] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4bed98c1-af24-4a10-871b-c74b7577b4c9 [ 895.446344] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.446693] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.446693] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.446693] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.446693] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.449870] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4bed98c1-af24-4a10-871b-c74b7577b4c9 already deleted. [ 895.449991] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4bed98c1-af24-4a10-871b-c74b7577b4c9" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.685365] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-56904b3c-38e4-4547-9a1d-cc787c3fef9d taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.685511] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-56904b3c-38e4-4547-9a1d-cc787c3fef9d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.685743] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6c66be3e-3e32-48ef-a2a5-ffb63a76a257 with status ACTIVE [ 895.686488] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.686711] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.686797] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.687203] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.687303] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.687508] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.687609] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.687669] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.687865] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.687957] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.688183] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.688278] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.688339] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.688522] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.688603] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.688690] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6c66be3e-3e32-48ef-a2a5-ffb63a76a257 is going to be updated. [ 895.711116] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.711296] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.711373] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.711584] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.711750] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.711944] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6c66be3e-3e32-48ef-a2a5-ffb63a76a257" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.191175] env[65306]: INFO networking_nsxv3.common.synchronization [req-d4f1694d-b05d-4e42-aadf-bf0de7c41746 req-13d9dc1c-ac13-4e04-94f5-93dbf35cbe52 tempest-ListServerFiltersTestJSON-702113484 tempest-ListServerFiltersTestJSON-702113484-project-member] Enqueued Resource ID: a3364d7c-b2fd-4f01-932a-1feef0fa76de with Priority: HIGHEST for action security_group_members [ 896.191924] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a3364d7c-b2fd-4f01-932a-1feef0fa76de with Priority: HIGHEST for action security_group_members [ 896.192330] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-a3364d7c-b2fd-4f01-932a-1feef0fa76de taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.192445] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a3364d7c-b2fd-4f01-932a-1feef0fa76de" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.192514] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a3364d7c-b2fd-4f01-932a-1feef0fa76de" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.192819] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a3364d7c-b2fd-4f01-932a-1feef0fa76de" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.192971] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.193114] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.193235] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.193404] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.193465] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.193603] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a3364d7c-b2fd-4f01-932a-1feef0fa76de',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 896.492840] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2cdaf88a-80a7-4019-9156-d7e0483af77f in Status: SUCCESS [ 896.492840] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2cdaf88a-80a7-4019-9156-d7e0483af77f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.492840] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2cdaf88a-80a7-4019-9156-d7e0483af77f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.492840] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2cdaf88a-80a7-4019-9156-d7e0483af77f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.492840] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.492840] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.492840] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.492840] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.492840] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.492840] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2cdaf88a-80a7-4019-9156-d7e0483af77f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.492840] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2cdaf88a-80a7-4019-9156-d7e0483af77f',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 896.658455] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock network-991 taken with stack trace [, , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.658661] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "network-991" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.658792] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "network-991" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.659248] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "network-991" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.660019] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.660192] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.660313] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.660617] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.660812] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.661118] env[65306]: DEBUG dogpile.cache.region [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] No value present for key: 'zone-id' {{(pid=65306) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 896.661248] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] NeedRegenerationException {{(pid=65306) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 896.661358] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] no value, waiting for create lock {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 896.661496] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] value creation lock acquired {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 896.661636] env[65306]: DEBUG dogpile.cache.region [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] No value present for key: 'zone-id' {{(pid=65306) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 896.661819] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Calling creation function for not-yet-present value {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 896.662035] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 896.684806] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 896.684990] env[65306]: DEBUG dogpile.cache.region [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65306) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 896.685143] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Released creation lock {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 896.685422] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "network-991" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.685858] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock port-299379cf-3c62-49a4-89e8-f29766c1fb81 taken with stack trace [, , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.686137] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "port-299379cf-3c62-49a4-89e8-f29766c1fb81" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.686288] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "port-299379cf-3c62-49a4-89e8-f29766c1fb81" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.686906] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "port-299379cf-3c62-49a4-89e8-f29766c1fb81" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.686906] env[65306]: DEBUG networking_nsxv3.api.rpc [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('299379cf-3c62-49a4-89e8-f29766c1fb81',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 896.697314] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.697314] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.697935] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.697935] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.697935] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.697935] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.697935] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.698126] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.698227] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.698273] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.698377] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a3364d7c-b2fd-4f01-932a-1feef0fa76de already deleted. [ 896.698414] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a3364d7c-b2fd-4f01-932a-1feef0fa76de" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.998207] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-2cdaf88a-80a7-4019-9156-d7e0483af77f taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.998375] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2cdaf88a-80a7-4019-9156-d7e0483af77f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.998443] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2cdaf88a-80a7-4019-9156-d7e0483af77f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.998660] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2cdaf88a-80a7-4019-9156-d7e0483af77f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.998845] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.998951] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.999035] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.999200] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.999301] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.999394] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2cdaf88a-80a7-4019-9156-d7e0483af77f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.999552] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-2cdaf88a-80a7-4019-9156-d7e0483af77f taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.999661] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2cdaf88a-80a7-4019-9156-d7e0483af77f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.999731] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2cdaf88a-80a7-4019-9156-d7e0483af77f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.999878] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2cdaf88a-80a7-4019-9156-d7e0483af77f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.000030] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.000147] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.000192] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.000321] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.000397] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.000498] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2cdaf88a-80a7-4019-9156-d7e0483af77f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.000612] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2cdaf88a-80a7-4019-9156-d7e0483af77f',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 897.035398] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 56904b3c-38e4-4547-9a1d-cc787c3fef9d in Status: SUCCESS [ 897.035776] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-56904b3c-38e4-4547-9a1d-cc787c3fef9d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.036008] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-56904b3c-38e4-4547-9a1d-cc787c3fef9d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.036277] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-56904b3c-38e4-4547-9a1d-cc787c3fef9d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.036702] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.036862] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.036935] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.037121] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.037240] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.037350] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('56904b3c-38e4-4547-9a1d-cc787c3fef9d',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 897.189639] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.189905] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.190036] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.190320] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.190475] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.191103] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Segment Port 299379cf-3c62-49a4-89e8-f29766c1fb81 not found, creating... [ 897.191103] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.191217] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.191431] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.191527] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.191685] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.192164] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.192351] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.192472] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.192694] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.192844] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.193009] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Resource: SegmentPort with ID: 299379cf-3c62-49a4-89e8-f29766c1fb81 is going to be created. [ 897.198684] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 563b7655-db8f-408d-8ce8-bfec6b58c669 in Status: SUCCESS [ 897.198911] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-563b7655-db8f-408d-8ce8-bfec6b58c669" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.215176] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.215378] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.215480] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.215750] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.215980] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.216245] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "port-299379cf-3c62-49a4-89e8-f29766c1fb81" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.505812] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2cdaf88a-80a7-4019-9156-d7e0483af77f: rpc.has_security_group_logging(os_id): False [ 897.529503] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.529767] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.529767] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.530162] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.530316] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.530594] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.530751] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.530856] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.531166] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.531349] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.531594] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.531736] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.531798] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.532062] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.532190] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.532840] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.532840] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.532840] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.532840] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.532840] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.533140] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2cdaf88a-80a7-4019-9156-d7e0483af77f is going to be created. [ 897.540737] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('56904b3c-38e4-4547-9a1d-cc787c3fef9d',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 897.610071] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.610071] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.610071] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.610071] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.610264] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.627526] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2cdaf88a-80a7-4019-9156-d7e0483af77f in Status: IN_PROGRESS for 2s [ 897.928364] env[65306]: INFO networking_nsxv3.common.synchronization [req-d4f1694d-b05d-4e42-aadf-bf0de7c41746 req-f414c0b3-72e9-4317-8b46-a0ec4c135e77 service nova] Enqueued Resource ID: a3364d7c-b2fd-4f01-932a-1feef0fa76de with Priority: HIGHEST for action security_group_rules [ 897.928510] env[65306]: INFO networking_nsxv3.common.synchronization [req-d4f1694d-b05d-4e42-aadf-bf0de7c41746 req-f414c0b3-72e9-4317-8b46-a0ec4c135e77 service nova] Enqueued Resource ID: a3364d7c-b2fd-4f01-932a-1feef0fa76de with Priority: HIGHEST for action security_group_members [ 897.928648] env[65306]: INFO networking_nsxv3.common.synchronization [req-d4f1694d-b05d-4e42-aadf-bf0de7c41746 req-f414c0b3-72e9-4317-8b46-a0ec4c135e77 service nova] Enqueued Resource ID: 299379cf-3c62-49a4-89e8-f29766c1fb81 with Priority: HIGHEST for action port [ 897.929157] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a3364d7c-b2fd-4f01-932a-1feef0fa76de with Priority: HIGHEST for action security_group_rules [ 897.929324] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a3364d7c-b2fd-4f01-932a-1feef0fa76de with Priority: HIGHEST for action security_group_members [ 897.929454] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 299379cf-3c62-49a4-89e8-f29766c1fb81 with Priority: HIGHEST for action port [ 897.929742] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a3364d7c-b2fd-4f01-932a-1feef0fa76de taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.929870] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a3364d7c-b2fd-4f01-932a-1feef0fa76de" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.929927] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a3364d7c-b2fd-4f01-932a-1feef0fa76de" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.930219] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a3364d7c-b2fd-4f01-932a-1feef0fa76de" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.930304] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a3364d7c-b2fd-4f01-932a-1feef0fa76de',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 897.932209] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-a3364d7c-b2fd-4f01-932a-1feef0fa76de taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.933350] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a3364d7c-b2fd-4f01-932a-1feef0fa76de" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.933480] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a3364d7c-b2fd-4f01-932a-1feef0fa76de" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.933837] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a3364d7c-b2fd-4f01-932a-1feef0fa76de" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.933987] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.934111] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.934178] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.934333] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.934419] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.934517] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a3364d7c-b2fd-4f01-932a-1feef0fa76de',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 897.935654] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock port-299379cf-3c62-49a4-89e8-f29766c1fb81 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.935765] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-299379cf-3c62-49a4-89e8-f29766c1fb81" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.935834] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-299379cf-3c62-49a4-89e8-f29766c1fb81" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.935987] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-299379cf-3c62-49a4-89e8-f29766c1fb81" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.936646] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('299379cf-3c62-49a4-89e8-f29766c1fb81',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 898.044033] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('56904b3c-38e4-4547-9a1d-cc787c3fef9d',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 898.439271] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 299379cf-3c62-49a4-89e8-f29766c1fb81 with status ACTIVE [ 898.439271] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.439567] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.439567] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.440370] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.440370] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.440370] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.440370] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.440688] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.440688] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.441793] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.441793] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.441793] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.441793] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.441793] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.441793] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.441793] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 299379cf-3c62-49a4-89e8-f29766c1fb81 is going to be updated. [ 898.444736] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a3364d7c-b2fd-4f01-932a-1feef0fa76de',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 898.446782] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-a3364d7c-b2fd-4f01-932a-1feef0fa76de taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.446782] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a3364d7c-b2fd-4f01-932a-1feef0fa76de" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.466357] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.466556] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.466617] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.466887] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.467138] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.468143] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-299379cf-3c62-49a4-89e8-f29766c1fb81" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.547713] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.548152] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.550159] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.550159] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.550159] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.550159] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 56904b3c-38e4-4547-9a1d-cc787c3fef9d is going to be updated. [ 898.599676] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.599839] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.599912] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.600176] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.600360] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.613855] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 56904b3c-38e4-4547-9a1d-cc787c3fef9d in Status: IN_PROGRESS for 2s [ 898.951752] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a3364d7c-b2fd-4f01-932a-1feef0fa76de',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 898.973521] env[65306]: INFO networking_nsxv3.common.synchronization [req-2718be78-c131-421b-891a-b9f68b181e65 req-84b0f454-b015-4671-a817-1867a842e943 tempest-ServerDiskConfigTestJSON-771154958 tempest-ServerDiskConfigTestJSON-771154958-project-member] Enqueued Resource ID: 9e80329d-1fcd-4c50-8991-a90e2a1fbdbc with Priority: HIGHEST for action security_group_members [ 898.976291] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9e80329d-1fcd-4c50-8991-a90e2a1fbdbc with Priority: HIGHEST for action security_group_members [ 898.976291] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-9e80329d-1fcd-4c50-8991-a90e2a1fbdbc taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.976291] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9e80329d-1fcd-4c50-8991-a90e2a1fbdbc" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.976291] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9e80329d-1fcd-4c50-8991-a90e2a1fbdbc" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.976291] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9e80329d-1fcd-4c50-8991-a90e2a1fbdbc" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.977121] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.977278] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.977367] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.977611] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.978356] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.978356] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9e80329d-1fcd-4c50-8991-a90e2a1fbdbc',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 899.456465] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.456745] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.456745] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.456861] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.457133] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.457133] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a3364d7c-b2fd-4f01-932a-1feef0fa76de is going to be created. [ 899.481840] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.481840] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.481840] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.482127] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.488069] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.488222] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.488296] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.488499] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.488665] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.514840] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a3364d7c-b2fd-4f01-932a-1feef0fa76de in Status: UNINITIALIZED for 2s [ 899.517886] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.517886] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.517886] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.517886] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.517886] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.517886] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.517886] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9e80329d-1fcd-4c50-8991-a90e2a1fbdbc is going to be updated. [ 899.548055] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.548426] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.548763] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.549099] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.549401] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.564062] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9e80329d-1fcd-4c50-8991-a90e2a1fbdbc in Status: IN_PROGRESS for 2s [ 899.642048] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2cdaf88a-80a7-4019-9156-d7e0483af77f in Status: SUCCESS [ 899.642048] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2cdaf88a-80a7-4019-9156-d7e0483af77f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.191630] env[65306]: INFO networking_nsxv3.common.synchronization [req-d2c0fb22-1e63-4e0c-abe6-0c84fabd4da9 req-6eb156de-b096-4faa-9ee8-d82d7f3fabd6 tempest-ImagesTestJSON-762064805 tempest-ImagesTestJSON-762064805-project-member] Enqueued Resource ID: 57bb6fe9-98c4-47f0-9daa-c424a0c9dfee with Priority: HIGHEST for action security_group_members [ 900.192346] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 57bb6fe9-98c4-47f0-9daa-c424a0c9dfee with Priority: HIGHEST for action security_group_members [ 900.193767] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-57bb6fe9-98c4-47f0-9daa-c424a0c9dfee taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.193767] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-57bb6fe9-98c4-47f0-9daa-c424a0c9dfee" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.193767] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-57bb6fe9-98c4-47f0-9daa-c424a0c9dfee" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.193767] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-57bb6fe9-98c4-47f0-9daa-c424a0c9dfee" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.193767] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.193767] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.193767] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.194101] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.194101] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.194630] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('57bb6fe9-98c4-47f0-9daa-c424a0c9dfee',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 900.626367] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 56904b3c-38e4-4547-9a1d-cc787c3fef9d in Status: SUCCESS [ 900.626824] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-56904b3c-38e4-4547-9a1d-cc787c3fef9d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.626824] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-56904b3c-38e4-4547-9a1d-cc787c3fef9d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.626968] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-56904b3c-38e4-4547-9a1d-cc787c3fef9d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.627183] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.627305] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.627371] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.627527] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.627606] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.627692] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-56904b3c-38e4-4547-9a1d-cc787c3fef9d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.627785] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('56904b3c-38e4-4547-9a1d-cc787c3fef9d',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 900.697164] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.697347] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.697413] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.697637] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.723254] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.724131] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.724131] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.724131] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.724131] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.724302] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.724389] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 57bb6fe9-98c4-47f0-9daa-c424a0c9dfee is going to be updated. [ 900.756186] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.756343] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.756413] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.756671] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.756784] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.769738] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 57bb6fe9-98c4-47f0-9daa-c424a0c9dfee in Status: IN_PROGRESS for 2s [ 901.133025] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-56904b3c-38e4-4547-9a1d-cc787c3fef9d taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.133025] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-56904b3c-38e4-4547-9a1d-cc787c3fef9d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.133025] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-56904b3c-38e4-4547-9a1d-cc787c3fef9d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.133025] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-56904b3c-38e4-4547-9a1d-cc787c3fef9d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.133025] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.133025] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.133025] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.133025] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.133025] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.133025] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-56904b3c-38e4-4547-9a1d-cc787c3fef9d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.133025] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-56904b3c-38e4-4547-9a1d-cc787c3fef9d taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.133025] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-56904b3c-38e4-4547-9a1d-cc787c3fef9d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.133025] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-56904b3c-38e4-4547-9a1d-cc787c3fef9d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.133025] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-56904b3c-38e4-4547-9a1d-cc787c3fef9d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.133025] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.133025] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.134032] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.134032] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.134032] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.134032] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-56904b3c-38e4-4547-9a1d-cc787c3fef9d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.134032] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('56904b3c-38e4-4547-9a1d-cc787c3fef9d',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 901.525876] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a3364d7c-b2fd-4f01-932a-1feef0fa76de in Status: SUCCESS [ 901.526194] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a3364d7c-b2fd-4f01-932a-1feef0fa76de" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.526395] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a3364d7c-b2fd-4f01-932a-1feef0fa76de" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.526610] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a3364d7c-b2fd-4f01-932a-1feef0fa76de" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.526802] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.527509] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.527509] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.527509] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.527509] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.527509] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a3364d7c-b2fd-4f01-932a-1feef0fa76de" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.527509] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a3364d7c-b2fd-4f01-932a-1feef0fa76de',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 901.575903] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9e80329d-1fcd-4c50-8991-a90e2a1fbdbc in Status: SUCCESS [ 901.576248] env[65306]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9e80329d-1fcd-4c50-8991-a90e2a1fbdbc deletion is rescheduled due to dependency. [ 901.576319] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9e80329d-1fcd-4c50-8991-a90e2a1fbdbc" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.636120] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 56904b3c-38e4-4547-9a1d-cc787c3fef9d: rpc.has_security_group_logging(os_id): False [ 901.654634] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.654782] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.654854] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.655082] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.675372] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.675642] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.675762] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.675842] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.676065] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.676160] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.676372] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.676491] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.676597] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.676707] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.676780] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.676953] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.677061] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.677140] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.677280] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.677355] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.677437] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 56904b3c-38e4-4547-9a1d-cc787c3fef9d is going to be updated. [ 901.750287] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.750464] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.750534] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.750745] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.750891] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.772519] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 56904b3c-38e4-4547-9a1d-cc787c3fef9d in Status: IN_PROGRESS for 2s [ 902.034612] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-a3364d7c-b2fd-4f01-932a-1feef0fa76de taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.034822] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a3364d7c-b2fd-4f01-932a-1feef0fa76de" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.034876] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a3364d7c-b2fd-4f01-932a-1feef0fa76de" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.036529] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a3364d7c-b2fd-4f01-932a-1feef0fa76de" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.036529] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.036529] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.036529] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.036529] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.036529] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.036529] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a3364d7c-b2fd-4f01-932a-1feef0fa76de" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.036529] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-a3364d7c-b2fd-4f01-932a-1feef0fa76de taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.036529] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a3364d7c-b2fd-4f01-932a-1feef0fa76de" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.036529] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a3364d7c-b2fd-4f01-932a-1feef0fa76de" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.036529] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a3364d7c-b2fd-4f01-932a-1feef0fa76de" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.036529] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.036529] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.036529] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.037567] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.037567] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.037567] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a3364d7c-b2fd-4f01-932a-1feef0fa76de" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.037567] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a3364d7c-b2fd-4f01-932a-1feef0fa76de',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 902.538851] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a3364d7c-b2fd-4f01-932a-1feef0fa76de: rpc.has_security_group_logging(os_id): False [ 902.561867] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.561867] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.561867] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.562186] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.562186] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.563248] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.563248] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.563248] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.563248] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.563248] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.563571] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.563571] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.563571] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.563693] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.563693] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.565032] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.565032] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.565032] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.565032] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.565032] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.565032] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a3364d7c-b2fd-4f01-932a-1feef0fa76de is going to be created. [ 902.630440] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.630663] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.630761] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.630991] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.631687] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.658115] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a3364d7c-b2fd-4f01-932a-1feef0fa76de in Status: IN_PROGRESS for 2s [ 902.789307] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 57bb6fe9-98c4-47f0-9daa-c424a0c9dfee in Status: SUCCESS [ 902.789594] env[65306]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 57bb6fe9-98c4-47f0-9daa-c424a0c9dfee deletion is rescheduled due to dependency. [ 902.789781] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-57bb6fe9-98c4-47f0-9daa-c424a0c9dfee" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.908588] env[65306]: INFO networking_nsxv3.common.synchronization [None req-69211015-b113-4015-8f00-37c17499450a None None] Enqueued Resource ID: 2434a0e4-5b54-4166-bc50-261789437af2 with Priority: HIGHEST for action port [ 902.908937] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2434a0e4-5b54-4166-bc50-261789437af2 with Priority: HIGHEST for action port [ 902.909099] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock port-2434a0e4-5b54-4166-bc50-261789437af2 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.909245] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2434a0e4-5b54-4166-bc50-261789437af2" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.909328] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2434a0e4-5b54-4166-bc50-261789437af2" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.909629] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2434a0e4-5b54-4166-bc50-261789437af2" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.909745] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2434a0e4-5b54-4166-bc50-261789437af2',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 903.414106] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2434a0e4-5b54-4166-bc50-261789437af2 [ 903.414106] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.414106] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.414106] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.414439] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.414439] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.414439] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2434a0e4-5b54-4166-bc50-261789437af2 already deleted. [ 903.414516] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2434a0e4-5b54-4166-bc50-261789437af2" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.780793] env[65306]: INFO networking_nsxv3.common.synchronization [None req-52b2a480-46b8-42ce-9cd1-01948785948b tempest-AttachVolumeNegativeTest-723798471 tempest-AttachVolumeNegativeTest-723798471-project-member] Enqueued Resource ID: 979b0e99-7f65-434d-a9e9-1ff018f5b499 with Priority: HIGHEST for action security_group_rules [ 903.781328] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 979b0e99-7f65-434d-a9e9-1ff018f5b499 with Priority: HIGHEST for action security_group_rules [ 903.781944] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock rules-979b0e99-7f65-434d-a9e9-1ff018f5b499 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.781944] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-979b0e99-7f65-434d-a9e9-1ff018f5b499" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.781944] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-979b0e99-7f65-434d-a9e9-1ff018f5b499" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.782735] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-979b0e99-7f65-434d-a9e9-1ff018f5b499" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.782832] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('979b0e99-7f65-434d-a9e9-1ff018f5b499',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 903.791109] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 56904b3c-38e4-4547-9a1d-cc787c3fef9d in Status: SUCCESS [ 903.791296] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-56904b3c-38e4-4547-9a1d-cc787c3fef9d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.896793] env[65306]: INFO networking_nsxv3.common.synchronization [None req-c905b908-4a85-4142-bc27-ae5d4bac6b35 tempest-AttachVolumeNegativeTest-723798471 tempest-AttachVolumeNegativeTest-723798471-project-member] Enqueued Resource ID: 979b0e99-7f65-434d-a9e9-1ff018f5b499 with Priority: HIGHEST for action security_group_rules [ 903.897530] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 979b0e99-7f65-434d-a9e9-1ff018f5b499 with Priority: HIGHEST for action security_group_rules [ 903.897870] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock rules-979b0e99-7f65-434d-a9e9-1ff018f5b499 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.897870] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-979b0e99-7f65-434d-a9e9-1ff018f5b499" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.309157] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.309157] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.309157] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.309157] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.309157] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.309157] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 979b0e99-7f65-434d-a9e9-1ff018f5b499 already deleted. [ 904.309157] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-979b0e99-7f65-434d-a9e9-1ff018f5b499" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.309157] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-979b0e99-7f65-434d-a9e9-1ff018f5b499" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.309157] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-979b0e99-7f65-434d-a9e9-1ff018f5b499" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.309561] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('979b0e99-7f65-434d-a9e9-1ff018f5b499',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 904.573797] env[65306]: INFO networking_nsxv3.common.synchronization [req-4545b8e9-8b7a-4fc3-8850-3c5be93af051 req-16be36e8-f6e6-4eb7-85b7-cba753fa71b3 tempest-InstanceActionsV221TestJSON-172623164 tempest-InstanceActionsV221TestJSON-172623164-project-member] Enqueued Resource ID: 563b7655-db8f-408d-8ce8-bfec6b58c669 with Priority: HIGHEST for action security_group_members [ 904.574532] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 563b7655-db8f-408d-8ce8-bfec6b58c669 with Priority: HIGHEST for action security_group_members [ 904.574969] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-563b7655-db8f-408d-8ce8-bfec6b58c669 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.575260] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-563b7655-db8f-408d-8ce8-bfec6b58c669" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.575260] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-563b7655-db8f-408d-8ce8-bfec6b58c669" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.575430] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-563b7655-db8f-408d-8ce8-bfec6b58c669" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.576115] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.576115] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.576115] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.576115] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.576115] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.576115] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('563b7655-db8f-408d-8ce8-bfec6b58c669',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 904.673046] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a3364d7c-b2fd-4f01-932a-1feef0fa76de in Status: SUCCESS [ 904.673046] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a3364d7c-b2fd-4f01-932a-1feef0fa76de" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.833958] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.833958] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.833958] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.834516] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.834516] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.834516] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 979b0e99-7f65-434d-a9e9-1ff018f5b499 already deleted. [ 904.834516] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-979b0e99-7f65-434d-a9e9-1ff018f5b499" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.081619] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.081862] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.081974] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.082170] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.082361] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.082478] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.082599] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.082668] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.082798] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.082873] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.082960] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 563b7655-db8f-408d-8ce8-bfec6b58c669 is going to be updated. [ 905.137937] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.137937] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.137937] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.137937] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.137937] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.150480] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 563b7655-db8f-408d-8ce8-bfec6b58c669 in Status: IN_PROGRESS for 2s [ 905.480753] env[65306]: INFO networking_nsxv3.common.synchronization [None req-afbe6387-1149-4d10-9b9d-0040e106ba04 None None] Enqueued Resource ID: 177f48a5-1a00-4c6e-9f23-5131343e4107 with Priority: HIGHEST for action port [ 905.483264] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 177f48a5-1a00-4c6e-9f23-5131343e4107 with Priority: HIGHEST for action port [ 905.483868] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock port-177f48a5-1a00-4c6e-9f23-5131343e4107 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.483868] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-177f48a5-1a00-4c6e-9f23-5131343e4107" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.483868] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-177f48a5-1a00-4c6e-9f23-5131343e4107" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.484089] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-177f48a5-1a00-4c6e-9f23-5131343e4107" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.484089] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('177f48a5-1a00-4c6e-9f23-5131343e4107',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.986640] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 177f48a5-1a00-4c6e-9f23-5131343e4107 [ 905.987123] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.987123] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.987123] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.988034] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.988034] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.988034] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:177f48a5-1a00-4c6e-9f23-5131343e4107 already deleted. [ 905.988034] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-177f48a5-1a00-4c6e-9f23-5131343e4107" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.479958] env[65306]: INFO networking_nsxv3.common.synchronization [req-7f1b2b18-08ac-458c-bd56-37645a0c1827 req-3c9861f1-5cd7-4cd2-ac21-b5486e83987f tempest-ServerMetadataTestJSON-1278073267 tempest-ServerMetadataTestJSON-1278073267-project-member] Enqueued Resource ID: 23ae6942-da1d-46a7-951e-aa32b51f50d2 with Priority: HIGHEST for action security_group_members [ 906.480320] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 23ae6942-da1d-46a7-951e-aa32b51f50d2 with Priority: HIGHEST for action security_group_members [ 906.481536] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-23ae6942-da1d-46a7-951e-aa32b51f50d2 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.481536] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-23ae6942-da1d-46a7-951e-aa32b51f50d2" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.481536] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-23ae6942-da1d-46a7-951e-aa32b51f50d2" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.481536] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-23ae6942-da1d-46a7-951e-aa32b51f50d2" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.481536] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.481536] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.481536] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.481536] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.481536] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.481880] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('23ae6942-da1d-46a7-951e-aa32b51f50d2',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 906.687511] env[65306]: INFO networking_nsxv3.common.synchronization [req-549be0ee-348f-4094-bbe2-e404d970d94e req-0ee9e501-2ae1-4906-b0e1-c437beb16cf2 tempest-ServersNegativeTestMultiTenantJSON-433533185 tempest-ServersNegativeTestMultiTenantJSON-433533185-project-member] Enqueued Resource ID: 2cdaf88a-80a7-4019-9156-d7e0483af77f with Priority: HIGHEST for action security_group_members [ 906.688647] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2cdaf88a-80a7-4019-9156-d7e0483af77f with Priority: HIGHEST for action security_group_members [ 906.688647] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-2cdaf88a-80a7-4019-9156-d7e0483af77f taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.688647] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2cdaf88a-80a7-4019-9156-d7e0483af77f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.688647] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2cdaf88a-80a7-4019-9156-d7e0483af77f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.689088] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2cdaf88a-80a7-4019-9156-d7e0483af77f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.689088] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.689088] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.689211] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.689560] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.689560] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.689560] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2cdaf88a-80a7-4019-9156-d7e0483af77f',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 906.984314] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.984467] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.984542] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.984764] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.984856] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.985110] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.985188] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.985218] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.985372] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.985447] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.985624] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 23ae6942-da1d-46a7-951e-aa32b51f50d2 is going to be updated. [ 907.016397] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.016687] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.016687] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.016846] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.017062] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.027927] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 23ae6942-da1d-46a7-951e-aa32b51f50d2 in Status: IN_PROGRESS for 2s [ 907.163787] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 563b7655-db8f-408d-8ce8-bfec6b58c669 in Status: SUCCESS [ 907.163920] env[65306]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 563b7655-db8f-408d-8ce8-bfec6b58c669 deletion is rescheduled due to dependency. [ 907.163976] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-563b7655-db8f-408d-8ce8-bfec6b58c669" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.192745] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.192963] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.193126] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.193427] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.193559] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.193882] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.193961] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.194062] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.194267] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.194381] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.194512] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2cdaf88a-80a7-4019-9156-d7e0483af77f is going to be updated. [ 907.223537] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.223696] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.223801] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.223982] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.224144] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.234576] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2cdaf88a-80a7-4019-9156-d7e0483af77f in Status: IN_PROGRESS for 2s [ 909.039359] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 23ae6942-da1d-46a7-951e-aa32b51f50d2 in Status: SUCCESS [ 909.039359] env[65306]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 23ae6942-da1d-46a7-951e-aa32b51f50d2 deletion is rescheduled due to dependency. [ 909.039665] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-23ae6942-da1d-46a7-951e-aa32b51f50d2" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.246042] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2cdaf88a-80a7-4019-9156-d7e0483af77f in Status: SUCCESS [ 909.246042] env[65306]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2cdaf88a-80a7-4019-9156-d7e0483af77f deletion is rescheduled due to dependency. [ 909.246208] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2cdaf88a-80a7-4019-9156-d7e0483af77f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.999087] env[65306]: INFO networking_nsxv3.common.synchronization [req-7976c78e-2b1f-4d42-93b8-bfe885864742 req-121dd058-8962-46d0-b6d6-6016c03c9d34 tempest-ListServerFiltersTestJSON-702113484 tempest-ListServerFiltersTestJSON-702113484-project-member] Enqueued Resource ID: a3364d7c-b2fd-4f01-932a-1feef0fa76de with Priority: HIGHEST for action security_group_members [ 909.999684] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a3364d7c-b2fd-4f01-932a-1feef0fa76de with Priority: HIGHEST for action security_group_members [ 910.000015] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-a3364d7c-b2fd-4f01-932a-1feef0fa76de taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.000525] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a3364d7c-b2fd-4f01-932a-1feef0fa76de" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.000618] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a3364d7c-b2fd-4f01-932a-1feef0fa76de" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.000813] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a3364d7c-b2fd-4f01-932a-1feef0fa76de" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.000957] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.001138] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.001258] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.001336] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.001426] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.001540] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a3364d7c-b2fd-4f01-932a-1feef0fa76de',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 910.413958] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock network-991 taken with stack trace [, , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.414299] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "network-991" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.414299] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "network-991" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.414556] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "network-991" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.414811] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.414963] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.415315] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.415555] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.415703] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.415914] env[65306]: DEBUG dogpile.cache.region [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] No value present for key: 'zone-id' {{(pid=65306) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 910.416040] env[65306]: DEBUG dogpile.lock [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] NeedRegenerationException {{(pid=65306) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 910.416198] env[65306]: DEBUG dogpile.lock [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] no value, waiting for create lock {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 910.416317] env[65306]: DEBUG dogpile.lock [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] value creation lock acquired {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 910.416431] env[65306]: DEBUG dogpile.cache.region [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] No value present for key: 'zone-id' {{(pid=65306) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 910.416538] env[65306]: DEBUG dogpile.lock [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Calling creation function for not-yet-present value {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 910.416673] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 910.437920] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 910.438464] env[65306]: DEBUG dogpile.cache.region [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65306) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 910.438464] env[65306]: DEBUG dogpile.lock [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Released creation lock {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 910.438464] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "network-991" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.438741] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock port-cfdf9d9e-7e02-4def-b33d-2f4f395ab5bc taken with stack trace [, , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.438876] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "port-cfdf9d9e-7e02-4def-b33d-2f4f395ab5bc" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.439119] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "port-cfdf9d9e-7e02-4def-b33d-2f4f395ab5bc" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.439468] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "port-cfdf9d9e-7e02-4def-b33d-2f4f395ab5bc" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.439608] env[65306]: DEBUG networking_nsxv3.api.rpc [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cfdf9d9e-7e02-4def-b33d-2f4f395ab5bc',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 910.503842] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a3364d7c-b2fd-4f01-932a-1feef0fa76de',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 910.621809] env[65306]: INFO networking_nsxv3.common.synchronization [req-7da75b40-6ee6-44c1-b54a-c735a31300b2 req-66d52431-8ac8-470b-aebe-76ce94c1487f tempest-MigrationsAdminTest-1842265666 tempest-MigrationsAdminTest-1842265666-project-member] Enqueued Resource ID: 8beaaac6-ba63-44e8-a960-7e228e2e7d37 with Priority: HIGHEST for action security_group_members [ 910.622373] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8beaaac6-ba63-44e8-a960-7e228e2e7d37 with Priority: HIGHEST for action security_group_members [ 910.622753] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-8beaaac6-ba63-44e8-a960-7e228e2e7d37 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.622865] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8beaaac6-ba63-44e8-a960-7e228e2e7d37" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.622865] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8beaaac6-ba63-44e8-a960-7e228e2e7d37" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.623081] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8beaaac6-ba63-44e8-a960-7e228e2e7d37" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.623234] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.623334] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.623388] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.623534] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.623619] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.623839] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8beaaac6-ba63-44e8-a960-7e228e2e7d37',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 910.942362] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.942502] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.942585] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.942902] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.943083] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.944029] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Segment Port cfdf9d9e-7e02-4def-b33d-2f4f395ab5bc not found, creating... [ 910.944029] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.944029] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.944029] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.944029] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.944267] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.945033] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.945033] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.945033] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.945033] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.945282] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.945282] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Resource: SegmentPort with ID: cfdf9d9e-7e02-4def-b33d-2f4f395ab5bc is going to be created. [ 910.972120] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.972381] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.972509] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.972793] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.973057] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.973317] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "port-cfdf9d9e-7e02-4def-b33d-2f4f395ab5bc" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.006361] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a3364d7c-b2fd-4f01-932a-1feef0fa76de',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 911.126229] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8beaaac6-ba63-44e8-a960-7e228e2e7d37',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 911.509780] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.510142] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.510142] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.510237] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.510340] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.510438] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a3364d7c-b2fd-4f01-932a-1feef0fa76de is going to be updated. [ 911.545986] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.546157] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.546230] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.546446] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.546615] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.556488] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a3364d7c-b2fd-4f01-932a-1feef0fa76de in Status: IN_PROGRESS for 2s [ 911.629279] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8beaaac6-ba63-44e8-a960-7e228e2e7d37',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 911.697619] env[65306]: INFO networking_nsxv3.common.synchronization [req-7976c78e-2b1f-4d42-93b8-bfe885864742 req-0cbc5c28-707e-4a4c-8343-c461f8443148 service nova] Enqueued Resource ID: a3364d7c-b2fd-4f01-932a-1feef0fa76de with Priority: HIGHEST for action security_group_rules [ 911.697801] env[65306]: INFO networking_nsxv3.common.synchronization [req-7976c78e-2b1f-4d42-93b8-bfe885864742 req-0cbc5c28-707e-4a4c-8343-c461f8443148 service nova] Enqueued Resource ID: a3364d7c-b2fd-4f01-932a-1feef0fa76de with Priority: HIGHEST for action security_group_members [ 911.697937] env[65306]: INFO networking_nsxv3.common.synchronization [req-7976c78e-2b1f-4d42-93b8-bfe885864742 req-0cbc5c28-707e-4a4c-8343-c461f8443148 service nova] Enqueued Resource ID: cfdf9d9e-7e02-4def-b33d-2f4f395ab5bc with Priority: HIGHEST for action port [ 911.698478] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a3364d7c-b2fd-4f01-932a-1feef0fa76de with Priority: HIGHEST for action security_group_rules [ 911.698611] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a3364d7c-b2fd-4f01-932a-1feef0fa76de with Priority: HIGHEST for action security_group_members [ 911.698725] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cfdf9d9e-7e02-4def-b33d-2f4f395ab5bc with Priority: HIGHEST for action port [ 911.699448] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a3364d7c-b2fd-4f01-932a-1feef0fa76de taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.699601] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a3364d7c-b2fd-4f01-932a-1feef0fa76de" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.699670] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a3364d7c-b2fd-4f01-932a-1feef0fa76de" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.699983] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a3364d7c-b2fd-4f01-932a-1feef0fa76de" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.700096] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a3364d7c-b2fd-4f01-932a-1feef0fa76de',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 911.701546] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-a3364d7c-b2fd-4f01-932a-1feef0fa76de taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.702593] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a3364d7c-b2fd-4f01-932a-1feef0fa76de" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.702593] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock port-cfdf9d9e-7e02-4def-b33d-2f4f395ab5bc taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.702593] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cfdf9d9e-7e02-4def-b33d-2f4f395ab5bc" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.702593] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cfdf9d9e-7e02-4def-b33d-2f4f395ab5bc" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.702593] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cfdf9d9e-7e02-4def-b33d-2f4f395ab5bc" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.702593] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cfdf9d9e-7e02-4def-b33d-2f4f395ab5bc',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 912.132190] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.133027] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.133027] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.133027] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.133027] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.133027] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8beaaac6-ba63-44e8-a960-7e228e2e7d37 is going to be updated. [ 912.167508] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.167779] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.167850] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.168075] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.168209] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.179701] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8beaaac6-ba63-44e8-a960-7e228e2e7d37 in Status: IN_PROGRESS for 2s [ 912.202802] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-a3364d7c-b2fd-4f01-932a-1feef0fa76de taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.202802] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a3364d7c-b2fd-4f01-932a-1feef0fa76de" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.205347] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port cfdf9d9e-7e02-4def-b33d-2f4f395ab5bc with status ACTIVE [ 912.206030] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.206030] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.206030] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.206227] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.206403] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.206844] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.206844] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.206844] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.207080] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.207214] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.207453] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.207603] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.207684] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.207932] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.208059] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.208182] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: cfdf9d9e-7e02-4def-b33d-2f4f395ab5bc is going to be updated. [ 912.235202] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.235413] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.235482] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.235700] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.235864] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.236064] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cfdf9d9e-7e02-4def-b33d-2f4f395ab5bc" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.507505] env[65306]: INFO networking_nsxv3.common.synchronization [req-46eacc43-79c9-456a-bcff-b3cd36492ad7 req-910f7eea-06ef-4378-813d-474401f26f53 tempest-ServersWithSpecificFlavorTestJSON-1706838422 tempest-ServersWithSpecificFlavorTestJSON-1706838422-project-member] Enqueued Resource ID: ef5de9e7-0c3b-4386-af3c-de134eff75f3 with Priority: HIGHEST for action security_group_members [ 912.508070] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ef5de9e7-0c3b-4386-af3c-de134eff75f3 with Priority: HIGHEST for action security_group_members [ 912.508385] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-ef5de9e7-0c3b-4386-af3c-de134eff75f3 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.508510] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ef5de9e7-0c3b-4386-af3c-de134eff75f3" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.508593] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ef5de9e7-0c3b-4386-af3c-de134eff75f3" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.509254] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ef5de9e7-0c3b-4386-af3c-de134eff75f3" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.509254] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.509254] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.509254] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.509254] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.509494] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.509494] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ef5de9e7-0c3b-4386-af3c-de134eff75f3',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 912.982992] env[65306]: INFO networking_nsxv3.common.synchronization [req-e60b7db8-b73c-4227-8f6a-380f479615a9 req-e86d1c2a-498d-429b-a226-f8064226b96c tempest-ServersNegativeTestJSON-1568308048 tempest-ServersNegativeTestJSON-1568308048-project-member] Enqueued Resource ID: 7c868cfd-e55d-4976-95db-5b3f64c76a5f with Priority: HIGHEST for action security_group_members [ 912.983580] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7c868cfd-e55d-4976-95db-5b3f64c76a5f with Priority: HIGHEST for action security_group_members [ 912.983987] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-7c868cfd-e55d-4976-95db-5b3f64c76a5f taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.984088] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7c868cfd-e55d-4976-95db-5b3f64c76a5f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.984088] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7c868cfd-e55d-4976-95db-5b3f64c76a5f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.984347] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7c868cfd-e55d-4976-95db-5b3f64c76a5f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.984500] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.984682] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.984682] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.984805] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.984890] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.984984] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7c868cfd-e55d-4976-95db-5b3f64c76a5f',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 913.011535] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.011708] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.011803] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.012124] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.038358] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.038658] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.038803] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.038869] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.039126] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.039216] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.039323] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ef5de9e7-0c3b-4386-af3c-de134eff75f3 is going to be updated. [ 913.074798] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.074961] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.075056] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.075308] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.075473] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.085743] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ef5de9e7-0c3b-4386-af3c-de134eff75f3 in Status: IN_PROGRESS for 2s [ 913.487843] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.488042] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.488116] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.488341] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.488435] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.488636] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.488734] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.488796] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.488943] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.489046] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.489141] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7c868cfd-e55d-4976-95db-5b3f64c76a5f already deleted. [ 913.489226] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7c868cfd-e55d-4976-95db-5b3f64c76a5f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.567568] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a3364d7c-b2fd-4f01-932a-1feef0fa76de in Status: SUCCESS [ 913.567823] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a3364d7c-b2fd-4f01-932a-1feef0fa76de" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.567995] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a3364d7c-b2fd-4f01-932a-1feef0fa76de" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.568334] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a3364d7c-b2fd-4f01-932a-1feef0fa76de" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.568396] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.568520] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.568588] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.568737] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.568819] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.568918] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a3364d7c-b2fd-4f01-932a-1feef0fa76de',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 913.612678] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock network-715 taken with stack trace [, , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.612939] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "network-715" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.612991] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "network-715" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.613391] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "network-715" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.613719] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.613896] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.614024] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.614302] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.614419] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.614789] env[65306]: DEBUG dogpile.cache.region [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] No value present for key: 'zone-id' {{(pid=65306) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 913.614927] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] NeedRegenerationException {{(pid=65306) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 913.615050] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] no value, waiting for create lock {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 913.615167] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] value creation lock acquired {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 913.615604] env[65306]: DEBUG dogpile.cache.region [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] No value present for key: 'zone-id' {{(pid=65306) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 913.615604] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Calling creation function for not-yet-present value {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 913.615707] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 913.637125] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 913.637706] env[65306]: DEBUG dogpile.cache.region [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65306) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 913.637920] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Released creation lock {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 913.638128] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "network-715" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.638458] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock port-6a4d5c10-35bc-48db-b46a-7c1816acd7b5 taken with stack trace [, , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.638626] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "port-6a4d5c10-35bc-48db-b46a-7c1816acd7b5" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.638743] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "port-6a4d5c10-35bc-48db-b46a-7c1816acd7b5" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.639142] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "port-6a4d5c10-35bc-48db-b46a-7c1816acd7b5" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.639290] env[65306]: DEBUG networking_nsxv3.api.rpc [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6a4d5c10-35bc-48db-b46a-7c1816acd7b5',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 914.071610] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a3364d7c-b2fd-4f01-932a-1feef0fa76de',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 914.142306] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.142547] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.142972] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.143074] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.143568] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.143568] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Segment Port 6a4d5c10-35bc-48db-b46a-7c1816acd7b5 not found, creating... [ 914.143719] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.144962] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.144962] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.144962] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.144962] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.144962] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.144962] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.144962] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.145320] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.145519] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.145965] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Resource: SegmentPort with ID: 6a4d5c10-35bc-48db-b46a-7c1816acd7b5 is going to be created. [ 914.168541] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.168795] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.168993] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.169305] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.169940] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.169940] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "port-6a4d5c10-35bc-48db-b46a-7c1816acd7b5" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.189716] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8beaaac6-ba63-44e8-a960-7e228e2e7d37 in Status: SUCCESS [ 914.189957] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8beaaac6-ba63-44e8-a960-7e228e2e7d37" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.574366] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a3364d7c-b2fd-4f01-932a-1feef0fa76de',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 914.877069] env[65306]: INFO networking_nsxv3.common.synchronization [req-e60b7db8-b73c-4227-8f6a-380f479615a9 req-1213a569-3cb8-4559-aba2-4c88e1397e73 service nova] Enqueued Resource ID: 7c868cfd-e55d-4976-95db-5b3f64c76a5f with Priority: HIGHEST for action security_group_rules [ 914.877271] env[65306]: INFO networking_nsxv3.common.synchronization [req-e60b7db8-b73c-4227-8f6a-380f479615a9 req-1213a569-3cb8-4559-aba2-4c88e1397e73 service nova] Enqueued Resource ID: 7c868cfd-e55d-4976-95db-5b3f64c76a5f with Priority: HIGHEST for action security_group_members [ 914.877412] env[65306]: INFO networking_nsxv3.common.synchronization [req-e60b7db8-b73c-4227-8f6a-380f479615a9 req-1213a569-3cb8-4559-aba2-4c88e1397e73 service nova] Enqueued Resource ID: 6a4d5c10-35bc-48db-b46a-7c1816acd7b5 with Priority: HIGHEST for action port [ 914.877941] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7c868cfd-e55d-4976-95db-5b3f64c76a5f with Priority: HIGHEST for action security_group_rules [ 914.878319] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7c868cfd-e55d-4976-95db-5b3f64c76a5f with Priority: HIGHEST for action security_group_members [ 914.878543] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6a4d5c10-35bc-48db-b46a-7c1816acd7b5 with Priority: HIGHEST for action port [ 914.879485] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7c868cfd-e55d-4976-95db-5b3f64c76a5f taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.880074] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7c868cfd-e55d-4976-95db-5b3f64c76a5f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.880202] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7c868cfd-e55d-4976-95db-5b3f64c76a5f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.880536] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7c868cfd-e55d-4976-95db-5b3f64c76a5f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.880705] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7c868cfd-e55d-4976-95db-5b3f64c76a5f',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 914.882145] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-7c868cfd-e55d-4976-95db-5b3f64c76a5f taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.882271] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7c868cfd-e55d-4976-95db-5b3f64c76a5f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.883380] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7c868cfd-e55d-4976-95db-5b3f64c76a5f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.883617] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7c868cfd-e55d-4976-95db-5b3f64c76a5f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.883830] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.883946] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.884258] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.884287] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.884357] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.884652] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7c868cfd-e55d-4976-95db-5b3f64c76a5f',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 914.885251] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock port-6a4d5c10-35bc-48db-b46a-7c1816acd7b5 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.885363] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6a4d5c10-35bc-48db-b46a-7c1816acd7b5" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.885428] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6a4d5c10-35bc-48db-b46a-7c1816acd7b5" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.885581] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6a4d5c10-35bc-48db-b46a-7c1816acd7b5" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.885660] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6a4d5c10-35bc-48db-b46a-7c1816acd7b5',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 915.079112] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.079112] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.079112] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.079112] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.079112] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.079112] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a3364d7c-b2fd-4f01-932a-1feef0fa76de is going to be updated. [ 915.097207] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ef5de9e7-0c3b-4386-af3c-de134eff75f3 in Status: SUCCESS [ 915.097207] env[65306]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ef5de9e7-0c3b-4386-af3c-de134eff75f3 deletion is rescheduled due to dependency. [ 915.097207] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ef5de9e7-0c3b-4386-af3c-de134eff75f3" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.122260] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.122431] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.122488] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.123018] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.123018] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.142680] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a3364d7c-b2fd-4f01-932a-1feef0fa76de in Status: IN_PROGRESS for 2s [ 915.387535] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-7c868cfd-e55d-4976-95db-5b3f64c76a5f taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.387670] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7c868cfd-e55d-4976-95db-5b3f64c76a5f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.387868] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7c868cfd-e55d-4976-95db-5b3f64c76a5f',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 915.389166] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6a4d5c10-35bc-48db-b46a-7c1816acd7b5 with status ACTIVE [ 915.389166] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.389351] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.389351] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.389459] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.389546] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.389714] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.389812] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.389870] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.390031] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.390115] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.390283] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.390369] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.390432] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.390908] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.390908] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.391047] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6a4d5c10-35bc-48db-b46a-7c1816acd7b5 is going to be updated. [ 915.416997] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.417236] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.417236] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.417450] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.417592] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.417752] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6a4d5c10-35bc-48db-b46a-7c1816acd7b5" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.512627] env[65306]: INFO networking_nsxv3.common.synchronization [req-10faf7c1-571b-4f7a-8689-9f0758b005ac req-c037be61-2014-49c7-bc64-1bde2a627ef7 tempest-ListServerFiltersTestJSON-702113484 tempest-ListServerFiltersTestJSON-702113484-project-member] Enqueued Resource ID: a3364d7c-b2fd-4f01-932a-1feef0fa76de with Priority: HIGHEST for action security_group_members [ 915.513093] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a3364d7c-b2fd-4f01-932a-1feef0fa76de with Priority: HIGHEST for action security_group_members [ 915.513702] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-a3364d7c-b2fd-4f01-932a-1feef0fa76de taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.513891] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a3364d7c-b2fd-4f01-932a-1feef0fa76de" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.893708] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7c868cfd-e55d-4976-95db-5b3f64c76a5f',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 916.304867] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock network-991 taken with stack trace [, , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.305187] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "network-991" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.305223] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "network-991" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.305460] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "network-991" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.305716] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.305871] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.305978] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.306329] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.306482] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.306686] env[65306]: DEBUG dogpile.cache.region [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] No value present for key: 'zone-id' {{(pid=65306) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 916.306796] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] NeedRegenerationException {{(pid=65306) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 916.306902] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] no value, waiting for create lock {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 916.307014] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] value creation lock acquired {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 916.307132] env[65306]: DEBUG dogpile.cache.region [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] No value present for key: 'zone-id' {{(pid=65306) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 916.307233] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Calling creation function for not-yet-present value {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 916.307370] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 916.342288] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 916.342455] env[65306]: DEBUG dogpile.cache.region [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Cache value generated in 0.035 seconds for key(s): 'zone-id' {{(pid=65306) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 916.342595] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Released creation lock {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 916.342770] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "network-991" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.343140] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock port-df80d5aa-a96d-46d5-aee0-b00f0b10498a taken with stack trace [, , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.343377] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "port-df80d5aa-a96d-46d5-aee0-b00f0b10498a" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.343560] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "port-df80d5aa-a96d-46d5-aee0-b00f0b10498a" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.344791] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "port-df80d5aa-a96d-46d5-aee0-b00f0b10498a" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.344791] env[65306]: DEBUG networking_nsxv3.api.rpc [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('df80d5aa-a96d-46d5-aee0-b00f0b10498a',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 916.396655] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.396828] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.396866] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.397093] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.397183] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.397281] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7c868cfd-e55d-4976-95db-5b3f64c76a5f is going to be created. [ 916.422516] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.422703] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.422703] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.422912] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.423103] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.432504] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7c868cfd-e55d-4976-95db-5b3f64c76a5f in Status: UNINITIALIZED for 2s [ 916.848382] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.848621] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.848754] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.849053] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.849203] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.849359] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Segment Port df80d5aa-a96d-46d5-aee0-b00f0b10498a not found, creating... [ 916.849610] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.849826] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.849867] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.850105] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.850235] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.850504] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.850653] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.850763] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.850956] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.851668] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.851887] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Resource: SegmentPort with ID: df80d5aa-a96d-46d5-aee0-b00f0b10498a is going to be created. [ 916.873222] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.873479] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.873609] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.873876] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.874145] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.874380] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "port-df80d5aa-a96d-46d5-aee0-b00f0b10498a" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.140271] env[65306]: INFO networking_nsxv3.common.synchronization [None req-33775c5e-2df2-4809-98be-0748bec7b145 None None] Enqueued Resource ID: 6164b9db-0143-4183-b1d1-abdccc7c8ab0 with Priority: HIGHEST for action port [ 917.142490] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6164b9db-0143-4183-b1d1-abdccc7c8ab0 with Priority: HIGHEST for action port [ 917.142960] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock port-6164b9db-0143-4183-b1d1-abdccc7c8ab0 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.143238] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6164b9db-0143-4183-b1d1-abdccc7c8ab0" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.143367] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6164b9db-0143-4183-b1d1-abdccc7c8ab0" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.143739] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6164b9db-0143-4183-b1d1-abdccc7c8ab0" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.143927] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6164b9db-0143-4183-b1d1-abdccc7c8ab0',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 917.155859] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a3364d7c-b2fd-4f01-932a-1feef0fa76de in Status: SUCCESS [ 917.156358] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a3364d7c-b2fd-4f01-932a-1feef0fa76de" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.156804] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a3364d7c-b2fd-4f01-932a-1feef0fa76de" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.157205] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a3364d7c-b2fd-4f01-932a-1feef0fa76de" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.157397] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.158026] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.158026] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.158026] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.158026] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.159048] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a3364d7c-b2fd-4f01-932a-1feef0fa76de" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.159048] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a3364d7c-b2fd-4f01-932a-1feef0fa76de',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 917.159550] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a3364d7c-b2fd-4f01-932a-1feef0fa76de" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.161019] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a3364d7c-b2fd-4f01-932a-1feef0fa76de" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.161371] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.161545] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.161669] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.161897] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.162008] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.162086] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a3364d7c-b2fd-4f01-932a-1feef0fa76de',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 917.562023] env[65306]: INFO networking_nsxv3.common.synchronization [req-10faf7c1-571b-4f7a-8689-9f0758b005ac req-815cfc7e-d652-4817-99fd-1e0a0cd6fb71 service nova] Enqueued Resource ID: a3364d7c-b2fd-4f01-932a-1feef0fa76de with Priority: HIGHEST for action security_group_rules [ 917.562023] env[65306]: INFO networking_nsxv3.common.synchronization [req-10faf7c1-571b-4f7a-8689-9f0758b005ac req-815cfc7e-d652-4817-99fd-1e0a0cd6fb71 service nova] Enqueued Resource ID: a3364d7c-b2fd-4f01-932a-1feef0fa76de with Priority: HIGHEST for action security_group_members [ 917.562023] env[65306]: INFO networking_nsxv3.common.synchronization [req-10faf7c1-571b-4f7a-8689-9f0758b005ac req-815cfc7e-d652-4817-99fd-1e0a0cd6fb71 service nova] Enqueued Resource ID: df80d5aa-a96d-46d5-aee0-b00f0b10498a with Priority: HIGHEST for action port [ 917.562489] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a3364d7c-b2fd-4f01-932a-1feef0fa76de with Priority: HIGHEST for action security_group_rules [ 917.562729] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a3364d7c-b2fd-4f01-932a-1feef0fa76de with Priority: HIGHEST for action security_group_members [ 917.562804] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: df80d5aa-a96d-46d5-aee0-b00f0b10498a with Priority: HIGHEST for action port [ 917.563100] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a3364d7c-b2fd-4f01-932a-1feef0fa76de taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.563207] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a3364d7c-b2fd-4f01-932a-1feef0fa76de" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.563406] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-a3364d7c-b2fd-4f01-932a-1feef0fa76de taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.563482] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a3364d7c-b2fd-4f01-932a-1feef0fa76de" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.564029] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock port-df80d5aa-a96d-46d5-aee0-b00f0b10498a taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.564160] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-df80d5aa-a96d-46d5-aee0-b00f0b10498a" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.564252] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-df80d5aa-a96d-46d5-aee0-b00f0b10498a" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.564572] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-df80d5aa-a96d-46d5-aee0-b00f0b10498a" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.564657] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('df80d5aa-a96d-46d5-aee0-b00f0b10498a',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 917.646785] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6164b9db-0143-4183-b1d1-abdccc7c8ab0 [ 917.647044] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.647678] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.647898] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.647980] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.648088] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.648186] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6164b9db-0143-4183-b1d1-abdccc7c8ab0 already deleted. [ 917.648268] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6164b9db-0143-4183-b1d1-abdccc7c8ab0" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.665276] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-a3364d7c-b2fd-4f01-932a-1feef0fa76de taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.665426] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a3364d7c-b2fd-4f01-932a-1feef0fa76de" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.667067] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a3364d7c-b2fd-4f01-932a-1feef0fa76de',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 918.070428] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port df80d5aa-a96d-46d5-aee0-b00f0b10498a with status ACTIVE [ 918.071022] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.071022] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.071022] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.071170] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.071262] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.071680] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.071680] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.071680] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.071776] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.071844] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.072010] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.072239] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.072239] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.072384] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.073032] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.073032] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: df80d5aa-a96d-46d5-aee0-b00f0b10498a is going to be updated. [ 918.100048] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.100778] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.100913] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.103170] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.103170] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.103170] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-df80d5aa-a96d-46d5-aee0-b00f0b10498a" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.170906] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a3364d7c-b2fd-4f01-932a-1feef0fa76de',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 918.442635] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7c868cfd-e55d-4976-95db-5b3f64c76a5f in Status: SUCCESS [ 918.442854] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7c868cfd-e55d-4976-95db-5b3f64c76a5f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.443037] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7c868cfd-e55d-4976-95db-5b3f64c76a5f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.443255] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7c868cfd-e55d-4976-95db-5b3f64c76a5f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.443447] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.443681] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.443681] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.443768] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.443850] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.443929] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7c868cfd-e55d-4976-95db-5b3f64c76a5f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.444032] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7c868cfd-e55d-4976-95db-5b3f64c76a5f',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 918.677228] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.677228] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.677550] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.677550] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.677617] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.678378] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a3364d7c-b2fd-4f01-932a-1feef0fa76de is going to be updated. [ 918.727194] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.727194] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.727194] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.727194] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.727194] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.738020] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a3364d7c-b2fd-4f01-932a-1feef0fa76de in Status: IN_PROGRESS for 2s [ 918.947055] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-7c868cfd-e55d-4976-95db-5b3f64c76a5f taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.947209] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7c868cfd-e55d-4976-95db-5b3f64c76a5f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.947209] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7c868cfd-e55d-4976-95db-5b3f64c76a5f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.947784] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7c868cfd-e55d-4976-95db-5b3f64c76a5f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.947784] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.947784] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.947784] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.947979] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.948096] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.948210] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7c868cfd-e55d-4976-95db-5b3f64c76a5f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.948337] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-7c868cfd-e55d-4976-95db-5b3f64c76a5f taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.948490] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7c868cfd-e55d-4976-95db-5b3f64c76a5f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.948490] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7c868cfd-e55d-4976-95db-5b3f64c76a5f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.948732] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7c868cfd-e55d-4976-95db-5b3f64c76a5f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.948865] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.948962] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.949094] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.949275] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.949355] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.949448] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7c868cfd-e55d-4976-95db-5b3f64c76a5f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.949558] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7c868cfd-e55d-4976-95db-5b3f64c76a5f',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 919.451958] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7c868cfd-e55d-4976-95db-5b3f64c76a5f: rpc.has_security_group_logging(os_id): False [ 919.474727] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.475234] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.475234] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.475234] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.475384] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.475485] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.475712] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.475712] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.476036] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.476036] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.476861] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.479050] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.479050] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.479050] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.479050] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.479050] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.479050] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.479050] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.479050] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.479050] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.479050] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7c868cfd-e55d-4976-95db-5b3f64c76a5f is going to be created. [ 919.492443] env[65306]: INFO networking_nsxv3.common.synchronization [None req-fb023250-f1ca-4d14-bed7-db6c20508b5b None None] Enqueued Resource ID: 72d77ccd-a530-4ad8-a073-da1609749ccc with Priority: HIGHEST for action port [ 919.492630] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 72d77ccd-a530-4ad8-a073-da1609749ccc with Priority: HIGHEST for action port [ 919.492947] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock port-72d77ccd-a530-4ad8-a073-da1609749ccc taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.493069] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-72d77ccd-a530-4ad8-a073-da1609749ccc" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.493139] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-72d77ccd-a530-4ad8-a073-da1609749ccc" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.493392] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-72d77ccd-a530-4ad8-a073-da1609749ccc" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.493566] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('72d77ccd-a530-4ad8-a073-da1609749ccc',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 919.551439] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.551596] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.551666] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.551864] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.552071] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.563635] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7c868cfd-e55d-4976-95db-5b3f64c76a5f in Status: IN_PROGRESS for 2s [ 919.996125] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 72d77ccd-a530-4ad8-a073-da1609749ccc [ 919.996448] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.996691] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.996691] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.996966] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.997126] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.997273] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:72d77ccd-a530-4ad8-a073-da1609749ccc already deleted. [ 919.997403] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-72d77ccd-a530-4ad8-a073-da1609749ccc" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.748748] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a3364d7c-b2fd-4f01-932a-1feef0fa76de in Status: SUCCESS [ 920.748748] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a3364d7c-b2fd-4f01-932a-1feef0fa76de" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.749646] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a3364d7c-b2fd-4f01-932a-1feef0fa76de" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.749646] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a3364d7c-b2fd-4f01-932a-1feef0fa76de" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.749646] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.749646] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.749646] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.749996] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.750147] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.750368] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a3364d7c-b2fd-4f01-932a-1feef0fa76de',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 921.253636] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a3364d7c-b2fd-4f01-932a-1feef0fa76de',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 921.577641] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7c868cfd-e55d-4976-95db-5b3f64c76a5f in Status: SUCCESS [ 921.577931] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7c868cfd-e55d-4976-95db-5b3f64c76a5f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.744899] env[65306]: INFO networking_nsxv3.common.synchronization [req-f2c20a63-d877-44db-8730-34aa832a9ba1 req-8e8658e5-59b0-4add-a082-c57aa19c78fa tempest-ServersTestJSON-1773114292 tempest-ServersTestJSON-1773114292-project-member] Enqueued Resource ID: 0cb41b0f-cdd2-4222-95b4-bafd614b7460 with Priority: HIGHEST for action security_group_members [ 921.745645] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0cb41b0f-cdd2-4222-95b4-bafd614b7460 with Priority: HIGHEST for action security_group_members [ 921.745959] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-0cb41b0f-cdd2-4222-95b4-bafd614b7460 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.746169] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0cb41b0f-cdd2-4222-95b4-bafd614b7460" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.746436] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0cb41b0f-cdd2-4222-95b4-bafd614b7460" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.746517] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0cb41b0f-cdd2-4222-95b4-bafd614b7460" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.746768] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.746945] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.747100] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.747339] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.747525] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.747688] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0cb41b0f-cdd2-4222-95b4-bafd614b7460',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 921.756121] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a3364d7c-b2fd-4f01-932a-1feef0fa76de',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 922.250258] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0cb41b0f-cdd2-4222-95b4-bafd614b7460',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 922.259473] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.259473] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.259473] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.259798] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.259826] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.259949] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a3364d7c-b2fd-4f01-932a-1feef0fa76de is going to be updated. [ 922.266246] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock network-949 taken with stack trace [, , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.266246] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "network-949" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.266246] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "network-949" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.266763] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "network-949" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.266763] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.267377] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.267421] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.267868] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.267868] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.268027] env[65306]: DEBUG dogpile.cache.region [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] No value present for key: 'zone-id' {{(pid=65306) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 922.268146] env[65306]: DEBUG dogpile.lock [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] NeedRegenerationException {{(pid=65306) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 922.268248] env[65306]: DEBUG dogpile.lock [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] no value, waiting for create lock {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 922.269035] env[65306]: DEBUG dogpile.lock [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] value creation lock acquired {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 922.269035] env[65306]: DEBUG dogpile.cache.region [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] No value present for key: 'zone-id' {{(pid=65306) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 922.269035] env[65306]: DEBUG dogpile.lock [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Calling creation function for not-yet-present value {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 922.269035] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 922.294359] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 922.295276] env[65306]: DEBUG dogpile.cache.region [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=65306) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 922.295276] env[65306]: DEBUG dogpile.lock [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Released creation lock {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 922.295276] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "network-949" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.295276] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock port-eeef07fd-3866-4fe6-88ee-8336ffdea010 taken with stack trace [, , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.295601] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "port-eeef07fd-3866-4fe6-88ee-8336ffdea010" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.295635] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "port-eeef07fd-3866-4fe6-88ee-8336ffdea010" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.295944] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "port-eeef07fd-3866-4fe6-88ee-8336ffdea010" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.296128] env[65306]: DEBUG networking_nsxv3.api.rpc [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('eeef07fd-3866-4fe6-88ee-8336ffdea010',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 922.304985] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.304985] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.304985] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.305238] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.305238] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.316690] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a3364d7c-b2fd-4f01-932a-1feef0fa76de in Status: IN_PROGRESS for 2s [ 922.752639] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0cb41b0f-cdd2-4222-95b4-bafd614b7460',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 922.799032] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.799195] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.799250] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.800033] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.800033] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.800033] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Segment Port eeef07fd-3866-4fe6-88ee-8336ffdea010 not found, creating... [ 922.800243] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.800431] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.800551] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.800774] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.800909] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.801248] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.801407] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.801524] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.801732] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.801866] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.802017] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Resource: SegmentPort with ID: eeef07fd-3866-4fe6-88ee-8336ffdea010 is going to be created. [ 922.823481] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.823687] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.823819] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.824123] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.824364] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.824594] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "port-eeef07fd-3866-4fe6-88ee-8336ffdea010" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.255579] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.255777] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.255864] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.256184] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.256317] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.256465] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0cb41b0f-cdd2-4222-95b4-bafd614b7460 is going to be updated. [ 923.291175] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.291497] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.291497] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.291813] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.292008] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.303255] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0cb41b0f-cdd2-4222-95b4-bafd614b7460 in Status: IN_PROGRESS for 2s [ 923.569676] env[65306]: INFO networking_nsxv3.common.synchronization [req-f2c20a63-d877-44db-8730-34aa832a9ba1 req-2c4ce1ba-b6a7-4141-b1d6-b1220e2c9c1f service nova] Enqueued Resource ID: 0cb41b0f-cdd2-4222-95b4-bafd614b7460 with Priority: HIGHEST for action security_group_rules [ 923.569882] env[65306]: INFO networking_nsxv3.common.synchronization [req-f2c20a63-d877-44db-8730-34aa832a9ba1 req-2c4ce1ba-b6a7-4141-b1d6-b1220e2c9c1f service nova] Enqueued Resource ID: 0cb41b0f-cdd2-4222-95b4-bafd614b7460 with Priority: HIGHEST for action security_group_members [ 923.570066] env[65306]: INFO networking_nsxv3.common.synchronization [req-f2c20a63-d877-44db-8730-34aa832a9ba1 req-2c4ce1ba-b6a7-4141-b1d6-b1220e2c9c1f service nova] Enqueued Resource ID: eeef07fd-3866-4fe6-88ee-8336ffdea010 with Priority: HIGHEST for action port [ 923.570704] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0cb41b0f-cdd2-4222-95b4-bafd614b7460 with Priority: HIGHEST for action security_group_rules [ 923.570786] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0cb41b0f-cdd2-4222-95b4-bafd614b7460 with Priority: HIGHEST for action security_group_members [ 923.570909] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eeef07fd-3866-4fe6-88ee-8336ffdea010 with Priority: HIGHEST for action port [ 923.571345] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0cb41b0f-cdd2-4222-95b4-bafd614b7460 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.571472] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0cb41b0f-cdd2-4222-95b4-bafd614b7460" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.571565] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0cb41b0f-cdd2-4222-95b4-bafd614b7460" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.571754] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0cb41b0f-cdd2-4222-95b4-bafd614b7460" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.571881] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0cb41b0f-cdd2-4222-95b4-bafd614b7460',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 923.572754] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-0cb41b0f-cdd2-4222-95b4-bafd614b7460 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.572850] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0cb41b0f-cdd2-4222-95b4-bafd614b7460" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.573061] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock port-eeef07fd-3866-4fe6-88ee-8336ffdea010 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.573182] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-eeef07fd-3866-4fe6-88ee-8336ffdea010" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.573246] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-eeef07fd-3866-4fe6-88ee-8336ffdea010" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.573416] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-eeef07fd-3866-4fe6-88ee-8336ffdea010" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.573510] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('eeef07fd-3866-4fe6-88ee-8336ffdea010',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 924.075127] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-0cb41b0f-cdd2-4222-95b4-bafd614b7460 taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.075266] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0cb41b0f-cdd2-4222-95b4-bafd614b7460" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.075461] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port eeef07fd-3866-4fe6-88ee-8336ffdea010 with status ACTIVE [ 924.075623] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.075735] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.075804] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.076023] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.076135] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.076326] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.076412] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.076479] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.076696] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.076696] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.076882] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.076978] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.077060] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.077210] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.077285] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.077370] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: eeef07fd-3866-4fe6-88ee-8336ffdea010 is going to be updated. [ 924.101729] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.101906] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.101997] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.102422] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.102528] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.102681] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-eeef07fd-3866-4fe6-88ee-8336ffdea010" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.332383] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a3364d7c-b2fd-4f01-932a-1feef0fa76de in Status: SUCCESS [ 924.332833] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a3364d7c-b2fd-4f01-932a-1feef0fa76de" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.332833] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a3364d7c-b2fd-4f01-932a-1feef0fa76de" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.333302] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a3364d7c-b2fd-4f01-932a-1feef0fa76de" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.333587] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.333716] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.333792] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.333968] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.334067] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.334201] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a3364d7c-b2fd-4f01-932a-1feef0fa76de" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.334388] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-a3364d7c-b2fd-4f01-932a-1feef0fa76de taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.334492] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a3364d7c-b2fd-4f01-932a-1feef0fa76de" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.334548] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a3364d7c-b2fd-4f01-932a-1feef0fa76de" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.334712] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a3364d7c-b2fd-4f01-932a-1feef0fa76de" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.335196] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.335313] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.335558] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.335730] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.335845] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.335948] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a3364d7c-b2fd-4f01-932a-1feef0fa76de" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.336092] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a3364d7c-b2fd-4f01-932a-1feef0fa76de',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 924.481111] env[65306]: INFO networking_nsxv3.common.synchronization [req-0c7afc94-e55a-4751-854a-d4d01738554b req-68960d27-efad-4b46-a749-03fec57ebc3a tempest-AttachVolumeTestJSON-1277615836 tempest-AttachVolumeTestJSON-1277615836-project-member] Enqueued Resource ID: 331be455-1cf8-4667-8d43-bd7a51712610 with Priority: HIGHEST for action security_group_members [ 924.481111] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 331be455-1cf8-4667-8d43-bd7a51712610 with Priority: HIGHEST for action security_group_members [ 924.481314] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-331be455-1cf8-4667-8d43-bd7a51712610 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.481410] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-331be455-1cf8-4667-8d43-bd7a51712610" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.481479] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-331be455-1cf8-4667-8d43-bd7a51712610" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.481757] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-331be455-1cf8-4667-8d43-bd7a51712610" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.482124] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.482271] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.482334] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.483167] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.483167] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.483167] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('331be455-1cf8-4667-8d43-bd7a51712610',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 924.840436] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a3364d7c-b2fd-4f01-932a-1feef0fa76de: rpc.has_security_group_logging(os_id): False [ 924.859976] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock network-802 taken with stack trace [, , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.859976] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "network-802" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.859976] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "network-802" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.859976] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "network-802" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.859976] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.859976] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.859976] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.859976] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.859976] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.859976] env[65306]: DEBUG dogpile.cache.region [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] No value present for key: 'zone-id' {{(pid=65306) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 924.860497] env[65306]: DEBUG dogpile.lock [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] NeedRegenerationException {{(pid=65306) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 924.860497] env[65306]: DEBUG dogpile.lock [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] no value, waiting for create lock {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 924.860497] env[65306]: DEBUG dogpile.lock [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] value creation lock acquired {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 924.860497] env[65306]: DEBUG dogpile.cache.region [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] No value present for key: 'zone-id' {{(pid=65306) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 924.860624] env[65306]: DEBUG dogpile.lock [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Calling creation function for not-yet-present value {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 924.860660] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 924.863499] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.863656] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.863787] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.863971] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.864082] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.864286] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.864384] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.864696] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.864696] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.864696] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.864857] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.864920] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.864985] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.865219] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.865394] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.865814] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.866062] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.866062] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.866328] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.866412] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.866500] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a3364d7c-b2fd-4f01-932a-1feef0fa76de is going to be updated. [ 924.885631] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 924.885810] env[65306]: DEBUG dogpile.cache.region [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=65306) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 924.886057] env[65306]: DEBUG dogpile.lock [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Released creation lock {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 924.886267] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "network-802" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.887035] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock port-1cd3f164-04cf-4236-a4f1-1f9b8358c579 taken with stack trace [, , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.887359] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "port-1cd3f164-04cf-4236-a4f1-1f9b8358c579" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.887609] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "port-1cd3f164-04cf-4236-a4f1-1f9b8358c579" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.888298] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "port-1cd3f164-04cf-4236-a4f1-1f9b8358c579" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.888495] env[65306]: DEBUG networking_nsxv3.api.rpc [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1cd3f164-04cf-4236-a4f1-1f9b8358c579',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 924.934587] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.934772] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.934812] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.935084] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.935171] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.949422] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a3364d7c-b2fd-4f01-932a-1feef0fa76de in Status: IN_PROGRESS for 2s [ 924.986030] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.986030] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.986030] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.986030] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.986030] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.986312] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.986312] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.986394] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.986506] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.986584] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.986671] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 331be455-1cf8-4667-8d43-bd7a51712610 already deleted. [ 924.986751] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-331be455-1cf8-4667-8d43-bd7a51712610" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.989272] env[65306]: INFO networking_nsxv3.common.synchronization [None req-87ae8eda-cd15-40b7-a3c4-8f095d24ca53 None None] Enqueued Resource ID: 500ad58f-9d3c-49ec-872a-1cb1965c290d with Priority: HIGHEST for action port [ 924.990111] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 500ad58f-9d3c-49ec-872a-1cb1965c290d with Priority: HIGHEST for action port [ 924.990479] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock port-500ad58f-9d3c-49ec-872a-1cb1965c290d taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.990623] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-500ad58f-9d3c-49ec-872a-1cb1965c290d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.990702] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-500ad58f-9d3c-49ec-872a-1cb1965c290d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.991304] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-500ad58f-9d3c-49ec-872a-1cb1965c290d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.991304] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('500ad58f-9d3c-49ec-872a-1cb1965c290d',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 925.314242] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0cb41b0f-cdd2-4222-95b4-bafd614b7460 in Status: SUCCESS [ 925.314466] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0cb41b0f-cdd2-4222-95b4-bafd614b7460" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.314649] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0cb41b0f-cdd2-4222-95b4-bafd614b7460" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.315719] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0cb41b0f-cdd2-4222-95b4-bafd614b7460" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.315719] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.315719] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.315719] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.315719] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.315719] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.315719] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0cb41b0f-cdd2-4222-95b4-bafd614b7460',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 925.392129] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.392454] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.392559] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.392785] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.392934] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.393105] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Segment Port 1cd3f164-04cf-4236-a4f1-1f9b8358c579 not found, creating... [ 925.393439] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.393591] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.393687] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.393859] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.393991] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.394296] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.394454] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.394570] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.394772] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.394900] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.395065] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Resource: SegmentPort with ID: 1cd3f164-04cf-4236-a4f1-1f9b8358c579 is going to be created. [ 925.416559] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.416825] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.417018] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.417425] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.421022] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.421022] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "port-1cd3f164-04cf-4236-a4f1-1f9b8358c579" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.493198] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 500ad58f-9d3c-49ec-872a-1cb1965c290d [ 925.493410] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.493517] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.493847] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.494168] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.494168] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.494168] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:500ad58f-9d3c-49ec-872a-1cb1965c290d already deleted. [ 925.495298] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-500ad58f-9d3c-49ec-872a-1cb1965c290d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.822381] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0cb41b0f-cdd2-4222-95b4-bafd614b7460',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 926.185272] env[65306]: INFO networking_nsxv3.common.synchronization [req-0c7afc94-e55a-4751-854a-d4d01738554b req-9aff21c6-db1b-49cb-ad09-04cdfc6de656 service nova] Enqueued Resource ID: 331be455-1cf8-4667-8d43-bd7a51712610 with Priority: HIGHEST for action security_group_rules [ 926.185451] env[65306]: INFO networking_nsxv3.common.synchronization [req-0c7afc94-e55a-4751-854a-d4d01738554b req-9aff21c6-db1b-49cb-ad09-04cdfc6de656 service nova] Enqueued Resource ID: 331be455-1cf8-4667-8d43-bd7a51712610 with Priority: HIGHEST for action security_group_members [ 926.185589] env[65306]: INFO networking_nsxv3.common.synchronization [req-0c7afc94-e55a-4751-854a-d4d01738554b req-9aff21c6-db1b-49cb-ad09-04cdfc6de656 service nova] Enqueued Resource ID: 1cd3f164-04cf-4236-a4f1-1f9b8358c579 with Priority: HIGHEST for action port [ 926.186139] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 331be455-1cf8-4667-8d43-bd7a51712610 with Priority: HIGHEST for action security_group_rules [ 926.186281] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 331be455-1cf8-4667-8d43-bd7a51712610 with Priority: HIGHEST for action security_group_members [ 926.186380] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1cd3f164-04cf-4236-a4f1-1f9b8358c579 with Priority: HIGHEST for action port [ 926.186659] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock rules-331be455-1cf8-4667-8d43-bd7a51712610 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.186927] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-331be455-1cf8-4667-8d43-bd7a51712610" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.186927] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-331be455-1cf8-4667-8d43-bd7a51712610" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.187084] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-331be455-1cf8-4667-8d43-bd7a51712610" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.187161] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('331be455-1cf8-4667-8d43-bd7a51712610',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 926.188423] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-331be455-1cf8-4667-8d43-bd7a51712610 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.188423] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-331be455-1cf8-4667-8d43-bd7a51712610" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.188423] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-331be455-1cf8-4667-8d43-bd7a51712610" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.188423] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-331be455-1cf8-4667-8d43-bd7a51712610" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.188423] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.188660] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.188660] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.188719] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.188762] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.189071] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('331be455-1cf8-4667-8d43-bd7a51712610',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 926.189969] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock port-1cd3f164-04cf-4236-a4f1-1f9b8358c579 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.189969] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1cd3f164-04cf-4236-a4f1-1f9b8358c579" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.190093] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1cd3f164-04cf-4236-a4f1-1f9b8358c579" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.190739] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1cd3f164-04cf-4236-a4f1-1f9b8358c579" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.190739] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1cd3f164-04cf-4236-a4f1-1f9b8358c579',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 926.329430] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0cb41b0f-cdd2-4222-95b4-bafd614b7460',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 926.693162] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-331be455-1cf8-4667-8d43-bd7a51712610 taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.693162] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-331be455-1cf8-4667-8d43-bd7a51712610" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.693162] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('331be455-1cf8-4667-8d43-bd7a51712610',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 926.700073] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1cd3f164-04cf-4236-a4f1-1f9b8358c579 with status ACTIVE [ 926.700073] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.700073] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.700073] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.700073] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.700073] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.700073] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.700073] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.700073] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.700073] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.700073] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.700073] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.700073] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.700073] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.700073] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.700073] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.700073] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1cd3f164-04cf-4236-a4f1-1f9b8358c579 is going to be updated. [ 926.731441] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.731441] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.731441] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.731441] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.731441] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.731441] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1cd3f164-04cf-4236-a4f1-1f9b8358c579" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.832908] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.833221] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.833221] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.833443] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.833536] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.833774] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0cb41b0f-cdd2-4222-95b4-bafd614b7460 is going to be updated. [ 926.881640] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.881640] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.881640] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.881640] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.881640] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.892970] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0cb41b0f-cdd2-4222-95b4-bafd614b7460 in Status: IN_PROGRESS for 2s [ 926.967189] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a3364d7c-b2fd-4f01-932a-1feef0fa76de in Status: SUCCESS [ 926.967483] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a3364d7c-b2fd-4f01-932a-1feef0fa76de" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.967483] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a3364d7c-b2fd-4f01-932a-1feef0fa76de" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.968158] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a3364d7c-b2fd-4f01-932a-1feef0fa76de" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.968158] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a3364d7c-b2fd-4f01-932a-1feef0fa76de',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 927.196210] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('331be455-1cf8-4667-8d43-bd7a51712610',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 927.472654] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-a3364d7c-b2fd-4f01-932a-1feef0fa76de taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.473049] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a3364d7c-b2fd-4f01-932a-1feef0fa76de" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.473169] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a3364d7c-b2fd-4f01-932a-1feef0fa76de" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.473732] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a3364d7c-b2fd-4f01-932a-1feef0fa76de" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.473805] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.473875] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.473998] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.474285] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.474695] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.474695] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a3364d7c-b2fd-4f01-932a-1feef0fa76de" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.474695] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a3364d7c-b2fd-4f01-932a-1feef0fa76de',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 927.700319] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.700319] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.700664] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.700664] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.700664] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.700807] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 331be455-1cf8-4667-8d43-bd7a51712610 is going to be created. [ 927.729496] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.729681] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.729728] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.729963] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.730145] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.747737] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 331be455-1cf8-4667-8d43-bd7a51712610 in Status: UNINITIALIZED for 2s [ 927.979300] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-a3364d7c-b2fd-4f01-932a-1feef0fa76de taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.979545] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a3364d7c-b2fd-4f01-932a-1feef0fa76de" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.979545] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a3364d7c-b2fd-4f01-932a-1feef0fa76de" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.979709] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a3364d7c-b2fd-4f01-932a-1feef0fa76de" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.979874] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.979976] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.980132] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.980297] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.980388] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.980478] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a3364d7c-b2fd-4f01-932a-1feef0fa76de" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.980619] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-a3364d7c-b2fd-4f01-932a-1feef0fa76de taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.980715] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a3364d7c-b2fd-4f01-932a-1feef0fa76de" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.980779] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a3364d7c-b2fd-4f01-932a-1feef0fa76de" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.980920] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a3364d7c-b2fd-4f01-932a-1feef0fa76de" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.981069] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.981195] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.981260] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.981406] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.981960] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.981960] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a3364d7c-b2fd-4f01-932a-1feef0fa76de" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.981960] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a3364d7c-b2fd-4f01-932a-1feef0fa76de',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 928.375665] env[65306]: INFO networking_nsxv3.common.synchronization [None req-c0ec96fe-a372-4727-b4b6-5ac8eb575837 None None] Enqueued Resource ID: 23245e33-01e9-45c4-a3f6-1d8334325234 with Priority: HIGHEST for action port [ 928.376112] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 23245e33-01e9-45c4-a3f6-1d8334325234 with Priority: HIGHEST for action port [ 928.376410] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock port-23245e33-01e9-45c4-a3f6-1d8334325234 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.376614] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-23245e33-01e9-45c4-a3f6-1d8334325234" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.376940] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-23245e33-01e9-45c4-a3f6-1d8334325234" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.376940] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-23245e33-01e9-45c4-a3f6-1d8334325234" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.377315] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('23245e33-01e9-45c4-a3f6-1d8334325234',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 928.486562] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a3364d7c-b2fd-4f01-932a-1feef0fa76de: rpc.has_security_group_logging(os_id): False [ 928.506853] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.507024] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.507133] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.507290] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.507387] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.507599] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.507699] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.507781] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.507908] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.507986] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.508224] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.508270] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.508359] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.508486] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.508606] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.508787] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.508905] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.508960] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.509131] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.509217] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.509307] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a3364d7c-b2fd-4f01-932a-1feef0fa76de is going to be updated. [ 928.578631] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.578776] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.578837] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.579060] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.579210] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.599026] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a3364d7c-b2fd-4f01-932a-1feef0fa76de in Status: IN_PROGRESS for 2s [ 928.880162] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 23245e33-01e9-45c4-a3f6-1d8334325234 [ 928.880476] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.882224] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.882224] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.882224] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.882224] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.882224] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:23245e33-01e9-45c4-a3f6-1d8334325234 already deleted. [ 928.882224] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-23245e33-01e9-45c4-a3f6-1d8334325234" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.906524] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0cb41b0f-cdd2-4222-95b4-bafd614b7460 in Status: SUCCESS [ 928.906524] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0cb41b0f-cdd2-4222-95b4-bafd614b7460" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.906524] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0cb41b0f-cdd2-4222-95b4-bafd614b7460" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.906524] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0cb41b0f-cdd2-4222-95b4-bafd614b7460" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.906664] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.906874] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.906874] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.906951] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.906990] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.907091] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0cb41b0f-cdd2-4222-95b4-bafd614b7460" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.907186] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0cb41b0f-cdd2-4222-95b4-bafd614b7460',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 929.410033] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-0cb41b0f-cdd2-4222-95b4-bafd614b7460 taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.410033] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0cb41b0f-cdd2-4222-95b4-bafd614b7460" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.410247] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0cb41b0f-cdd2-4222-95b4-bafd614b7460" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.410300] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0cb41b0f-cdd2-4222-95b4-bafd614b7460" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.410467] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.410572] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.410638] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.410788] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.410889] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.410983] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0cb41b0f-cdd2-4222-95b4-bafd614b7460" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.411270] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-0cb41b0f-cdd2-4222-95b4-bafd614b7460 taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.411516] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0cb41b0f-cdd2-4222-95b4-bafd614b7460" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.411613] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0cb41b0f-cdd2-4222-95b4-bafd614b7460" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.411804] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0cb41b0f-cdd2-4222-95b4-bafd614b7460" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.411996] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.412206] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.412318] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.412484] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.412582] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.412673] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0cb41b0f-cdd2-4222-95b4-bafd614b7460" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.412768] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0cb41b0f-cdd2-4222-95b4-bafd614b7460',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 929.760204] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 331be455-1cf8-4667-8d43-bd7a51712610 in Status: SUCCESS [ 929.760456] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-331be455-1cf8-4667-8d43-bd7a51712610" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.760658] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-331be455-1cf8-4667-8d43-bd7a51712610" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.760880] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-331be455-1cf8-4667-8d43-bd7a51712610" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.761136] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.761253] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.761322] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.761513] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.761599] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.761689] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-331be455-1cf8-4667-8d43-bd7a51712610" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.761784] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('331be455-1cf8-4667-8d43-bd7a51712610',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 929.915756] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0cb41b0f-cdd2-4222-95b4-bafd614b7460: rpc.has_security_group_logging(os_id): False [ 929.940260] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.940260] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.940260] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.940260] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.967833] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.967950] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.968034] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.968109] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.968312] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.968395] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.969332] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.969332] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.969332] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.969332] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.969332] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.969565] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.969637] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.969698] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.969912] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.970016] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.970121] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0cb41b0f-cdd2-4222-95b4-bafd614b7460 is going to be updated. [ 930.024028] env[65306]: INFO networking_nsxv3.common.synchronization [req-49c2f06c-f26b-4a6b-a440-42f1cb887601 req-55bda4f6-5ebe-4d43-931f-c899e53213b1 tempest-SecurityGroupsTestJSON-960025904 tempest-SecurityGroupsTestJSON-960025904-project-member] Enqueued Resource ID: 7f0c403f-7209-472e-8592-d169f66791c9 with Priority: HIGHEST for action security_group_members [ 930.024028] env[65306]: INFO networking_nsxv3.common.synchronization [req-49c2f06c-f26b-4a6b-a440-42f1cb887601 req-55bda4f6-5ebe-4d43-931f-c899e53213b1 tempest-SecurityGroupsTestJSON-960025904 tempest-SecurityGroupsTestJSON-960025904-project-member] Enqueued Resource ID: 4e234e08-a192-4c7a-badf-3e57629854d7 with Priority: HIGHEST for action security_group_members [ 930.025977] env[65306]: INFO networking_nsxv3.common.synchronization [req-49c2f06c-f26b-4a6b-a440-42f1cb887601 req-55bda4f6-5ebe-4d43-931f-c899e53213b1 tempest-SecurityGroupsTestJSON-960025904 tempest-SecurityGroupsTestJSON-960025904-project-member] Enqueued Resource ID: ca47d813-3b19-4aa2-8339-4f933a85963f with Priority: HIGHEST for action security_group_members [ 930.026446] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7f0c403f-7209-472e-8592-d169f66791c9 with Priority: HIGHEST for action security_group_members [ 930.026589] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4e234e08-a192-4c7a-badf-3e57629854d7 with Priority: HIGHEST for action security_group_members [ 930.026702] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ca47d813-3b19-4aa2-8339-4f933a85963f with Priority: HIGHEST for action security_group_members [ 930.027021] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-7f0c403f-7209-472e-8592-d169f66791c9 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.027146] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7f0c403f-7209-472e-8592-d169f66791c9" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.027199] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7f0c403f-7209-472e-8592-d169f66791c9" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.027442] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7f0c403f-7209-472e-8592-d169f66791c9" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.027605] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.027727] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.027784] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.027921] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.027993] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.028101] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7f0c403f-7209-472e-8592-d169f66791c9',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 930.029026] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-4e234e08-a192-4c7a-badf-3e57629854d7 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.030645] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4e234e08-a192-4c7a-badf-3e57629854d7" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.030645] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4e234e08-a192-4c7a-badf-3e57629854d7" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.030645] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4e234e08-a192-4c7a-badf-3e57629854d7" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.030874] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.030874] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.030874] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.031317] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.031432] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.031530] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4e234e08-a192-4c7a-badf-3e57629854d7',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 930.032737] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-ca47d813-3b19-4aa2-8339-4f933a85963f taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.032737] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ca47d813-3b19-4aa2-8339-4f933a85963f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.032737] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ca47d813-3b19-4aa2-8339-4f933a85963f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.032933] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ca47d813-3b19-4aa2-8339-4f933a85963f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.033040] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.033141] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.033204] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.033348] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.033433] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.033539] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ca47d813-3b19-4aa2-8339-4f933a85963f',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 930.051954] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.052213] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.052582] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.052582] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.052830] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.071585] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0cb41b0f-cdd2-4222-95b4-bafd614b7460 in Status: IN_PROGRESS for 2s [ 930.265714] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('331be455-1cf8-4667-8d43-bd7a51712610',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 930.535372] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.536576] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.537871] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.537871] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.537871] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.537871] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.537871] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.537871] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.538145] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.538227] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.538338] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4e234e08-a192-4c7a-badf-3e57629854d7 is going to be updated. [ 930.539684] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.540159] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.540159] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.540159] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.541322] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.541457] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.565070] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.565350] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.565441] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.565486] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.566033] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.566033] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.566033] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7f0c403f-7209-472e-8592-d169f66791c9 is going to be updated. [ 930.568479] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.568813] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.571931] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.572362] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.572475] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.572764] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.572980] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.578324] env[65306]: INFO networking_nsxv3.common.synchronization [req-a9bb5ce1-93b8-4888-a5bd-cfe952073c97 req-a55fc05e-5a1c-4a0f-bf9f-8a2443d25ea7 tempest-AttachInterfacesTestJSON-144464476 tempest-AttachInterfacesTestJSON-144464476-project-member] Enqueued Resource ID: 50a889c1-6336-4320-94ea-df1e6eaa778c with Priority: HIGHEST for action security_group_members [ 930.579467] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 50a889c1-6336-4320-94ea-df1e6eaa778c with Priority: HIGHEST for action security_group_members [ 930.579467] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-50a889c1-6336-4320-94ea-df1e6eaa778c taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.579467] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-50a889c1-6336-4320-94ea-df1e6eaa778c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.579467] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-50a889c1-6336-4320-94ea-df1e6eaa778c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.579692] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-50a889c1-6336-4320-94ea-df1e6eaa778c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.579692] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.579772] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.579861] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.579988] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.580087] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.580181] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('50a889c1-6336-4320-94ea-df1e6eaa778c',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 930.583133] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4e234e08-a192-4c7a-badf-3e57629854d7 in Status: IN_PROGRESS for 2s [ 930.605817] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.606169] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.606817] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.606907] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.607147] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.607233] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.607339] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ca47d813-3b19-4aa2-8339-4f933a85963f is going to be updated. [ 930.619059] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.619218] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.619286] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.619492] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.619721] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.627999] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a3364d7c-b2fd-4f01-932a-1feef0fa76de in Status: SUCCESS [ 930.628256] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a3364d7c-b2fd-4f01-932a-1feef0fa76de" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.629547] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7f0c403f-7209-472e-8592-d169f66791c9 in Status: IN_PROGRESS for 2s [ 930.646258] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.646686] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.646686] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.646789] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.646952] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.659634] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ca47d813-3b19-4aa2-8339-4f933a85963f in Status: IN_PROGRESS for 2s [ 930.768830] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 331be455-1cf8-4667-8d43-bd7a51712610: rpc.has_security_group_logging(os_id): False [ 930.788879] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.789388] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.789496] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.789726] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.789821] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.790096] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.790207] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.790273] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.790422] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.790535] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.790589] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 331be455-1cf8-4667-8d43-bd7a51712610 is going to be created. [ 930.857136] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.857258] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.857336] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.857604] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.857727] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.872245] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 331be455-1cf8-4667-8d43-bd7a51712610 in Status: IN_PROGRESS for 2s [ 930.918312] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock network-540 taken with stack trace [, , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.918597] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "network-540" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.918632] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "network-540" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.918956] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "network-540" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.919248] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.919398] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.919523] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.919744] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.919972] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.920111] env[65306]: DEBUG dogpile.cache.region [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] No value present for key: 'zone-id' {{(pid=65306) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 930.920225] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] NeedRegenerationException {{(pid=65306) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 930.920354] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] no value, waiting for create lock {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 930.920465] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] value creation lock acquired {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 930.920555] env[65306]: DEBUG dogpile.cache.region [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] No value present for key: 'zone-id' {{(pid=65306) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 930.920738] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Calling creation function for not-yet-present value {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 930.920819] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 930.941412] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 930.941668] env[65306]: DEBUG dogpile.cache.region [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65306) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 930.941838] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Released creation lock {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 930.942150] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "network-540" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.942575] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock port-e1a97a68-efe4-4d43-9552-fb6733ed10d9 taken with stack trace [, , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.942813] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "port-e1a97a68-efe4-4d43-9552-fb6733ed10d9" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.942985] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "port-e1a97a68-efe4-4d43-9552-fb6733ed10d9" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.943460] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "port-e1a97a68-efe4-4d43-9552-fb6733ed10d9" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.943625] env[65306]: DEBUG networking_nsxv3.api.rpc [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e1a97a68-efe4-4d43-9552-fb6733ed10d9',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 931.083057] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.083250] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.083330] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.083876] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.083876] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.084106] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.084199] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.084279] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.084486] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.084574] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.084668] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 50a889c1-6336-4320-94ea-df1e6eaa778c already deleted. [ 931.084751] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-50a889c1-6336-4320-94ea-df1e6eaa778c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.445749] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.446085] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.446334] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.446752] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.446997] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.447108] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Segment Port e1a97a68-efe4-4d43-9552-fb6733ed10d9 not found, creating... [ 931.447380] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.447552] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.447665] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.447902] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.448054] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.448369] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.448530] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.448634] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.448846] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.448981] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.449346] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Resource: SegmentPort with ID: e1a97a68-efe4-4d43-9552-fb6733ed10d9 is going to be created. [ 931.473603] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.473838] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.473965] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.474339] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.474574] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.474811] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "port-e1a97a68-efe4-4d43-9552-fb6733ed10d9" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.089259] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0cb41b0f-cdd2-4222-95b4-bafd614b7460 in Status: SUCCESS [ 932.089709] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0cb41b0f-cdd2-4222-95b4-bafd614b7460" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.210156] env[65306]: INFO networking_nsxv3.common.synchronization [req-a9bb5ce1-93b8-4888-a5bd-cfe952073c97 req-1863956f-021d-4913-b290-5177f06bccd2 service nova] Enqueued Resource ID: 50a889c1-6336-4320-94ea-df1e6eaa778c with Priority: HIGHEST for action security_group_rules [ 932.210350] env[65306]: INFO networking_nsxv3.common.synchronization [req-a9bb5ce1-93b8-4888-a5bd-cfe952073c97 req-1863956f-021d-4913-b290-5177f06bccd2 service nova] Enqueued Resource ID: 50a889c1-6336-4320-94ea-df1e6eaa778c with Priority: HIGHEST for action security_group_members [ 932.210489] env[65306]: INFO networking_nsxv3.common.synchronization [req-a9bb5ce1-93b8-4888-a5bd-cfe952073c97 req-1863956f-021d-4913-b290-5177f06bccd2 service nova] Enqueued Resource ID: e1a97a68-efe4-4d43-9552-fb6733ed10d9 with Priority: HIGHEST for action port [ 932.211154] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 50a889c1-6336-4320-94ea-df1e6eaa778c with Priority: HIGHEST for action security_group_rules [ 932.211273] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 50a889c1-6336-4320-94ea-df1e6eaa778c with Priority: HIGHEST for action security_group_members [ 932.211374] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e1a97a68-efe4-4d43-9552-fb6733ed10d9 with Priority: HIGHEST for action port [ 932.211775] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock rules-50a889c1-6336-4320-94ea-df1e6eaa778c taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.211926] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-50a889c1-6336-4320-94ea-df1e6eaa778c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.211926] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-50a889c1-6336-4320-94ea-df1e6eaa778c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.212123] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-50a889c1-6336-4320-94ea-df1e6eaa778c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.212223] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('50a889c1-6336-4320-94ea-df1e6eaa778c',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 932.213149] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-50a889c1-6336-4320-94ea-df1e6eaa778c taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.213289] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-50a889c1-6336-4320-94ea-df1e6eaa778c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.213360] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-50a889c1-6336-4320-94ea-df1e6eaa778c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.213501] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-50a889c1-6336-4320-94ea-df1e6eaa778c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.213647] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.213776] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.213907] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.213986] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.214073] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.214284] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('50a889c1-6336-4320-94ea-df1e6eaa778c',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 932.215027] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock port-e1a97a68-efe4-4d43-9552-fb6733ed10d9 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.215167] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e1a97a68-efe4-4d43-9552-fb6733ed10d9" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.215167] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e1a97a68-efe4-4d43-9552-fb6733ed10d9" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.215519] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e1a97a68-efe4-4d43-9552-fb6733ed10d9" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.215519] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e1a97a68-efe4-4d43-9552-fb6733ed10d9',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 932.593591] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4e234e08-a192-4c7a-badf-3e57629854d7 in Status: SUCCESS [ 932.593786] env[65306]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4e234e08-a192-4c7a-badf-3e57629854d7 deletion is rescheduled due to dependency. [ 932.593906] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4e234e08-a192-4c7a-badf-3e57629854d7" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.644707] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7f0c403f-7209-472e-8592-d169f66791c9 in Status: SUCCESS [ 932.644984] env[65306]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7f0c403f-7209-472e-8592-d169f66791c9 deletion is rescheduled due to dependency. [ 932.645426] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7f0c403f-7209-472e-8592-d169f66791c9" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.671579] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ca47d813-3b19-4aa2-8339-4f933a85963f in Status: SUCCESS [ 932.671835] env[65306]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ca47d813-3b19-4aa2-8339-4f933a85963f deletion is rescheduled due to dependency. [ 932.672038] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ca47d813-3b19-4aa2-8339-4f933a85963f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.718464] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-50a889c1-6336-4320-94ea-df1e6eaa778c taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.718664] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-50a889c1-6336-4320-94ea-df1e6eaa778c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.719042] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('50a889c1-6336-4320-94ea-df1e6eaa778c',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 932.720267] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e1a97a68-efe4-4d43-9552-fb6733ed10d9 with status ACTIVE [ 932.720489] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.720750] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.720819] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.721461] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.721461] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.721576] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.721645] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.721700] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.721876] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.721971] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.722173] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.722486] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.722594] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.722711] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.722797] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.722890] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e1a97a68-efe4-4d43-9552-fb6733ed10d9 is going to be updated. [ 932.747987] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.747987] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.747987] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.747987] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.747987] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.747987] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e1a97a68-efe4-4d43-9552-fb6733ed10d9" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.886063] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 331be455-1cf8-4667-8d43-bd7a51712610 in Status: SUCCESS [ 932.886306] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-331be455-1cf8-4667-8d43-bd7a51712610" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.225345] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('50a889c1-6336-4320-94ea-df1e6eaa778c',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 933.730141] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.730141] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.730449] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.730481] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.730631] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.730737] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 50a889c1-6336-4320-94ea-df1e6eaa778c is going to be created. [ 933.758341] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.758531] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.758600] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.758822] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.758986] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.770066] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 50a889c1-6336-4320-94ea-df1e6eaa778c in Status: UNINITIALIZED for 2s [ 935.783209] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 50a889c1-6336-4320-94ea-df1e6eaa778c in Status: SUCCESS [ 935.783533] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-50a889c1-6336-4320-94ea-df1e6eaa778c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.783591] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-50a889c1-6336-4320-94ea-df1e6eaa778c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.783797] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-50a889c1-6336-4320-94ea-df1e6eaa778c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.783984] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.784113] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.784181] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.784334] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.784410] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.784499] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-50a889c1-6336-4320-94ea-df1e6eaa778c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.784589] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('50a889c1-6336-4320-94ea-df1e6eaa778c',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 935.847850] env[65306]: INFO networking_nsxv3.common.synchronization [req-828f5f43-8bdd-4c55-9b11-c1cf70f57d8d req-01a31f09-e947-4123-8606-4abf64f853a5 tempest-ServersTestJSON-1773114292 tempest-ServersTestJSON-1773114292-project-member] Enqueued Resource ID: 0cb41b0f-cdd2-4222-95b4-bafd614b7460 with Priority: HIGHEST for action security_group_members [ 935.848008] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0cb41b0f-cdd2-4222-95b4-bafd614b7460 with Priority: HIGHEST for action security_group_members [ 935.849186] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-0cb41b0f-cdd2-4222-95b4-bafd614b7460 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.849186] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0cb41b0f-cdd2-4222-95b4-bafd614b7460" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.849186] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0cb41b0f-cdd2-4222-95b4-bafd614b7460" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.849186] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0cb41b0f-cdd2-4222-95b4-bafd614b7460" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.849186] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.849186] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.849186] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.849474] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.849474] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.849600] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0cb41b0f-cdd2-4222-95b4-bafd614b7460',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 936.287577] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('50a889c1-6336-4320-94ea-df1e6eaa778c',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 936.355998] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0cb41b0f-cdd2-4222-95b4-bafd614b7460',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 936.583915] env[65306]: INFO networking_nsxv3.common.synchronization [req-1664d214-da64-4bc7-b80c-8c5818448f53 req-2ec725e0-d351-41e5-8d48-a49976564352 tempest-ServerDiskConfigTestJSON-771154958 tempest-ServerDiskConfigTestJSON-771154958-project-member] Enqueued Resource ID: 9e80329d-1fcd-4c50-8991-a90e2a1fbdbc with Priority: HIGHEST for action security_group_members [ 936.584981] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9e80329d-1fcd-4c50-8991-a90e2a1fbdbc with Priority: HIGHEST for action security_group_members [ 936.585319] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-9e80329d-1fcd-4c50-8991-a90e2a1fbdbc taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.585319] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9e80329d-1fcd-4c50-8991-a90e2a1fbdbc" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.585487] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9e80329d-1fcd-4c50-8991-a90e2a1fbdbc" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.586155] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9e80329d-1fcd-4c50-8991-a90e2a1fbdbc" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.586155] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.586155] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.586155] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.586155] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.586341] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.586341] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9e80329d-1fcd-4c50-8991-a90e2a1fbdbc',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 936.789790] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 50a889c1-6336-4320-94ea-df1e6eaa778c: rpc.has_security_group_logging(os_id): False [ 936.807883] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.808062] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.808149] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.808668] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.808668] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.808668] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.808822] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.808822] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.808949] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.809108] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.809235] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 50a889c1-6336-4320-94ea-df1e6eaa778c is going to be created. [ 936.858658] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0cb41b0f-cdd2-4222-95b4-bafd614b7460',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 936.872278] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.872493] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.872567] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.872731] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.872905] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.886768] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 50a889c1-6336-4320-94ea-df1e6eaa778c in Status: IN_PROGRESS for 2s [ 936.937908] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock network-681 taken with stack trace [, , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.938166] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "network-681" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.938284] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "network-681" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.938561] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "network-681" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.938994] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.939180] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.939299] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.939527] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.939671] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.939874] env[65306]: DEBUG dogpile.cache.region [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] No value present for key: 'zone-id' {{(pid=65306) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 936.939987] env[65306]: DEBUG dogpile.lock [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] NeedRegenerationException {{(pid=65306) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 936.940105] env[65306]: DEBUG dogpile.lock [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] no value, waiting for create lock {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 936.940210] env[65306]: DEBUG dogpile.lock [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] value creation lock acquired {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 936.940320] env[65306]: DEBUG dogpile.cache.region [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] No value present for key: 'zone-id' {{(pid=65306) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 936.940423] env[65306]: DEBUG dogpile.lock [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Calling creation function for not-yet-present value {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 936.940551] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 936.963897] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 936.964108] env[65306]: DEBUG dogpile.cache.region [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65306) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 936.964260] env[65306]: DEBUG dogpile.lock [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Released creation lock {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 936.964440] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "network-681" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.964755] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock port-41afa5ac-495b-4f89-85a4-376bcf917134 taken with stack trace [, , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.964926] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "port-41afa5ac-495b-4f89-85a4-376bcf917134" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.965054] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "port-41afa5ac-495b-4f89-85a4-376bcf917134" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.965406] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "port-41afa5ac-495b-4f89-85a4-376bcf917134" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.965550] env[65306]: DEBUG networking_nsxv3.api.rpc [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('41afa5ac-495b-4f89-85a4-376bcf917134',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 937.088556] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.088842] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.088948] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.089242] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.089366] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.089668] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.089812] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.089908] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.090163] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.090261] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.091299] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9e80329d-1fcd-4c50-8991-a90e2a1fbdbc is going to be updated. [ 937.120869] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.121190] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.121190] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.121447] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.121593] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.133644] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9e80329d-1fcd-4c50-8991-a90e2a1fbdbc in Status: IN_PROGRESS for 2s [ 937.362166] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.362166] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.362411] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.362536] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.363160] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.363160] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0cb41b0f-cdd2-4222-95b4-bafd614b7460 is going to be updated. [ 937.409995] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.410166] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.410230] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.411038] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.411038] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.422431] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0cb41b0f-cdd2-4222-95b4-bafd614b7460 in Status: IN_PROGRESS for 2s [ 937.470821] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.471192] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.471413] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.471851] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.472121] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.472405] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Segment Port 41afa5ac-495b-4f89-85a4-376bcf917134 not found, creating... [ 937.472845] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.473135] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.473351] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.473735] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.473969] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.474453] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.474714] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.474931] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.475278] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.475502] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.475747] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Resource: SegmentPort with ID: 41afa5ac-495b-4f89-85a4-376bcf917134 is going to be created. [ 937.500910] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.501209] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.501531] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.501833] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.502082] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.502385] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "port-41afa5ac-495b-4f89-85a4-376bcf917134" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.214549] env[65306]: INFO networking_nsxv3.common.synchronization [req-1664d214-da64-4bc7-b80c-8c5818448f53 req-5e4381bd-37fd-4895-9c42-7f09a17ad72e service nova] Enqueued Resource ID: 9e80329d-1fcd-4c50-8991-a90e2a1fbdbc with Priority: HIGHEST for action security_group_rules [ 938.214800] env[65306]: INFO networking_nsxv3.common.synchronization [req-1664d214-da64-4bc7-b80c-8c5818448f53 req-5e4381bd-37fd-4895-9c42-7f09a17ad72e service nova] Enqueued Resource ID: 9e80329d-1fcd-4c50-8991-a90e2a1fbdbc with Priority: HIGHEST for action security_group_members [ 938.214832] env[65306]: INFO networking_nsxv3.common.synchronization [req-1664d214-da64-4bc7-b80c-8c5818448f53 req-5e4381bd-37fd-4895-9c42-7f09a17ad72e service nova] Enqueued Resource ID: 41afa5ac-495b-4f89-85a4-376bcf917134 with Priority: HIGHEST for action port [ 938.215444] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9e80329d-1fcd-4c50-8991-a90e2a1fbdbc with Priority: HIGHEST for action security_group_rules [ 938.215579] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9e80329d-1fcd-4c50-8991-a90e2a1fbdbc with Priority: HIGHEST for action security_group_members [ 938.215737] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 41afa5ac-495b-4f89-85a4-376bcf917134 with Priority: HIGHEST for action port [ 938.216110] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9e80329d-1fcd-4c50-8991-a90e2a1fbdbc taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.216353] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9e80329d-1fcd-4c50-8991-a90e2a1fbdbc" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.216425] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9e80329d-1fcd-4c50-8991-a90e2a1fbdbc" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.216666] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9e80329d-1fcd-4c50-8991-a90e2a1fbdbc" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.216753] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9e80329d-1fcd-4c50-8991-a90e2a1fbdbc',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 938.217673] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-9e80329d-1fcd-4c50-8991-a90e2a1fbdbc taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.217766] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9e80329d-1fcd-4c50-8991-a90e2a1fbdbc" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.218345] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock port-41afa5ac-495b-4f89-85a4-376bcf917134 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.218465] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-41afa5ac-495b-4f89-85a4-376bcf917134" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.218521] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-41afa5ac-495b-4f89-85a4-376bcf917134" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.218693] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-41afa5ac-495b-4f89-85a4-376bcf917134" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.218985] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('41afa5ac-495b-4f89-85a4-376bcf917134',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 938.720115] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-9e80329d-1fcd-4c50-8991-a90e2a1fbdbc taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.720253] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9e80329d-1fcd-4c50-8991-a90e2a1fbdbc" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.720475] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 41afa5ac-495b-4f89-85a4-376bcf917134 with status ACTIVE [ 938.720673] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.720835] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.720924] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.721169] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.721284] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.721487] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.721623] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.721718] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.721890] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.721970] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.722232] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.722366] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.722450] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.722619] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.722716] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.722821] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 41afa5ac-495b-4f89-85a4-376bcf917134 is going to be updated. [ 938.745282] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.745502] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.745502] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.745692] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.745830] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.745994] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-41afa5ac-495b-4f89-85a4-376bcf917134" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.908453] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 50a889c1-6336-4320-94ea-df1e6eaa778c in Status: SUCCESS [ 938.908453] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-50a889c1-6336-4320-94ea-df1e6eaa778c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.145308] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9e80329d-1fcd-4c50-8991-a90e2a1fbdbc in Status: SUCCESS [ 939.145539] env[65306]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9e80329d-1fcd-4c50-8991-a90e2a1fbdbc deletion is rescheduled due to dependency. [ 939.145635] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9e80329d-1fcd-4c50-8991-a90e2a1fbdbc" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.145807] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9e80329d-1fcd-4c50-8991-a90e2a1fbdbc" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.146058] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9e80329d-1fcd-4c50-8991-a90e2a1fbdbc" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.146516] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.146516] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.146516] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.146849] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.146849] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.146849] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9e80329d-1fcd-4c50-8991-a90e2a1fbdbc',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 939.438079] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0cb41b0f-cdd2-4222-95b4-bafd614b7460 in Status: SUCCESS [ 939.438079] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0cb41b0f-cdd2-4222-95b4-bafd614b7460" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.651241] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9e80329d-1fcd-4c50-8991-a90e2a1fbdbc',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 940.152596] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9e80329d-1fcd-4c50-8991-a90e2a1fbdbc',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 940.655071] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.655672] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.655672] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.655672] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.655672] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.656202] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9e80329d-1fcd-4c50-8991-a90e2a1fbdbc is going to be updated. [ 940.689450] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.689594] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.689667] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.689867] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.690015] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.700797] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9e80329d-1fcd-4c50-8991-a90e2a1fbdbc in Status: IN_PROGRESS for 2s [ 941.369353] env[65306]: INFO networking_nsxv3.common.synchronization [req-cf7f1bc8-ca9d-47f7-9da0-80670402d948 req-7e093e9f-df82-4b40-8b12-88e520753bd7 tempest-ImagesTestJSON-762064805 tempest-ImagesTestJSON-762064805-project-member] Enqueued Resource ID: 57bb6fe9-98c4-47f0-9daa-c424a0c9dfee with Priority: HIGHEST for action security_group_members [ 941.370066] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 57bb6fe9-98c4-47f0-9daa-c424a0c9dfee with Priority: HIGHEST for action security_group_members [ 941.370178] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-57bb6fe9-98c4-47f0-9daa-c424a0c9dfee taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.370298] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-57bb6fe9-98c4-47f0-9daa-c424a0c9dfee" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.370370] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-57bb6fe9-98c4-47f0-9daa-c424a0c9dfee" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.371081] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-57bb6fe9-98c4-47f0-9daa-c424a0c9dfee" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.371172] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.371428] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.371428] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.371531] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.371633] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.371705] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('57bb6fe9-98c4-47f0-9daa-c424a0c9dfee',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 941.724842] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock network-873 taken with stack trace [, , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.725118] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "network-873" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.725185] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "network-873" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.725447] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "network-873" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.725701] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.725891] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.725985] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.726582] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.726745] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.726958] env[65306]: DEBUG dogpile.cache.region [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] No value present for key: 'zone-id' {{(pid=65306) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 941.727082] env[65306]: DEBUG dogpile.lock [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] NeedRegenerationException {{(pid=65306) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 941.727189] env[65306]: DEBUG dogpile.lock [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] no value, waiting for create lock {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 941.727299] env[65306]: DEBUG dogpile.lock [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] value creation lock acquired {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 941.727413] env[65306]: DEBUG dogpile.cache.region [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] No value present for key: 'zone-id' {{(pid=65306) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 941.727520] env[65306]: DEBUG dogpile.lock [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Calling creation function for not-yet-present value {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 941.727655] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 941.749499] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 941.749499] env[65306]: DEBUG dogpile.cache.region [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65306) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 941.749704] env[65306]: DEBUG dogpile.lock [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Released creation lock {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 941.749981] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "network-873" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.750445] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock port-e9e9ac28-2f98-45ff-9da5-d187b14b83cf taken with stack trace [, , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.750944] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "port-e9e9ac28-2f98-45ff-9da5-d187b14b83cf" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.751075] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "port-e9e9ac28-2f98-45ff-9da5-d187b14b83cf" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.752398] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "port-e9e9ac28-2f98-45ff-9da5-d187b14b83cf" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.752638] env[65306]: DEBUG networking_nsxv3.api.rpc [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e9e9ac28-2f98-45ff-9da5-d187b14b83cf',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 941.875651] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.875651] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.875651] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.875651] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.875651] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.875651] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.875651] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.875979] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.875979] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.875979] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.876080] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 57bb6fe9-98c4-47f0-9daa-c424a0c9dfee is going to be updated. [ 941.904371] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.904371] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.904371] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.904644] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.904693] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.916467] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 57bb6fe9-98c4-47f0-9daa-c424a0c9dfee in Status: IN_PROGRESS for 2s [ 942.255646] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.256456] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.256456] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.256456] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.256696] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.256696] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Segment Port e9e9ac28-2f98-45ff-9da5-d187b14b83cf not found, creating... [ 942.257438] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.257438] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.257438] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.258208] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.258208] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.258208] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.258400] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.258400] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.258707] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.258907] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.259113] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Resource: SegmentPort with ID: e9e9ac28-2f98-45ff-9da5-d187b14b83cf is going to be created. [ 942.292609] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.292848] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.293027] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.293382] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.293666] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.293833] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "port-e9e9ac28-2f98-45ff-9da5-d187b14b83cf" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.713240] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9e80329d-1fcd-4c50-8991-a90e2a1fbdbc in Status: SUCCESS [ 942.713568] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9e80329d-1fcd-4c50-8991-a90e2a1fbdbc" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.713775] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9e80329d-1fcd-4c50-8991-a90e2a1fbdbc" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.714075] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9e80329d-1fcd-4c50-8991-a90e2a1fbdbc" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.714363] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.714505] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.714554] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.714742] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.714827] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.714916] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9e80329d-1fcd-4c50-8991-a90e2a1fbdbc" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.715186] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9e80329d-1fcd-4c50-8991-a90e2a1fbdbc',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 943.009297] env[65306]: INFO networking_nsxv3.common.synchronization [req-cf7f1bc8-ca9d-47f7-9da0-80670402d948 req-798aed4d-139e-4e1b-8bed-37c7137160f7 service nova] Enqueued Resource ID: 57bb6fe9-98c4-47f0-9daa-c424a0c9dfee with Priority: HIGHEST for action security_group_rules [ 943.009297] env[65306]: INFO networking_nsxv3.common.synchronization [req-cf7f1bc8-ca9d-47f7-9da0-80670402d948 req-798aed4d-139e-4e1b-8bed-37c7137160f7 service nova] Enqueued Resource ID: 57bb6fe9-98c4-47f0-9daa-c424a0c9dfee with Priority: HIGHEST for action security_group_members [ 943.009297] env[65306]: INFO networking_nsxv3.common.synchronization [req-cf7f1bc8-ca9d-47f7-9da0-80670402d948 req-798aed4d-139e-4e1b-8bed-37c7137160f7 service nova] Enqueued Resource ID: e9e9ac28-2f98-45ff-9da5-d187b14b83cf with Priority: HIGHEST for action port [ 943.009297] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 57bb6fe9-98c4-47f0-9daa-c424a0c9dfee with Priority: HIGHEST for action security_group_rules [ 943.009297] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 57bb6fe9-98c4-47f0-9daa-c424a0c9dfee with Priority: HIGHEST for action security_group_members [ 943.009944] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e9e9ac28-2f98-45ff-9da5-d187b14b83cf with Priority: HIGHEST for action port [ 943.010378] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock rules-57bb6fe9-98c4-47f0-9daa-c424a0c9dfee taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.011233] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-57bb6fe9-98c4-47f0-9daa-c424a0c9dfee" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.012293] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-57bb6fe9-98c4-47f0-9daa-c424a0c9dfee" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.012293] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-57bb6fe9-98c4-47f0-9daa-c424a0c9dfee" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.012293] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('57bb6fe9-98c4-47f0-9daa-c424a0c9dfee',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 943.013214] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-57bb6fe9-98c4-47f0-9daa-c424a0c9dfee taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.013214] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-57bb6fe9-98c4-47f0-9daa-c424a0c9dfee" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.013214] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock port-e9e9ac28-2f98-45ff-9da5-d187b14b83cf taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.013214] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e9e9ac28-2f98-45ff-9da5-d187b14b83cf" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.013461] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e9e9ac28-2f98-45ff-9da5-d187b14b83cf" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.013461] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e9e9ac28-2f98-45ff-9da5-d187b14b83cf" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.013599] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e9e9ac28-2f98-45ff-9da5-d187b14b83cf',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 943.217592] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-9e80329d-1fcd-4c50-8991-a90e2a1fbdbc taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.217753] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9e80329d-1fcd-4c50-8991-a90e2a1fbdbc" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.217823] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9e80329d-1fcd-4c50-8991-a90e2a1fbdbc" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.218048] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9e80329d-1fcd-4c50-8991-a90e2a1fbdbc" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.218215] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.218320] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.218385] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.218564] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.218668] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.218762] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9e80329d-1fcd-4c50-8991-a90e2a1fbdbc" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.218910] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-9e80329d-1fcd-4c50-8991-a90e2a1fbdbc taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.219013] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9e80329d-1fcd-4c50-8991-a90e2a1fbdbc" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.219086] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9e80329d-1fcd-4c50-8991-a90e2a1fbdbc" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.219243] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9e80329d-1fcd-4c50-8991-a90e2a1fbdbc" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.219399] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.219558] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.219558] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.219731] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.219774] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.219845] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9e80329d-1fcd-4c50-8991-a90e2a1fbdbc" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.219932] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9e80329d-1fcd-4c50-8991-a90e2a1fbdbc',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 943.515548] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-57bb6fe9-98c4-47f0-9daa-c424a0c9dfee taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.516016] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-57bb6fe9-98c4-47f0-9daa-c424a0c9dfee" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.522905] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e9e9ac28-2f98-45ff-9da5-d187b14b83cf with status ACTIVE [ 943.523159] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.523293] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.523366] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.523606] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.523705] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.523870] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.523971] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.524045] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.524226] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.524320] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.524507] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.524602] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.524665] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.524803] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.524878] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.524963] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e9e9ac28-2f98-45ff-9da5-d187b14b83cf is going to be updated. [ 943.558753] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.558753] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.558753] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.558753] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.559092] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.559092] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e9e9ac28-2f98-45ff-9da5-d187b14b83cf" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.722733] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9e80329d-1fcd-4c50-8991-a90e2a1fbdbc: rpc.has_security_group_logging(os_id): False [ 943.740641] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.740641] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.740641] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.740641] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.741062] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.741062] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.741062] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.741062] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.741286] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.741286] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.741465] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.741557] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.741618] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.741757] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.741829] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.742011] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.742106] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.742255] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.742367] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.742471] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.742566] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9e80329d-1fcd-4c50-8991-a90e2a1fbdbc is going to be updated. [ 943.818391] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.818580] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.818626] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.818838] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.819034] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.834893] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9e80329d-1fcd-4c50-8991-a90e2a1fbdbc in Status: IN_PROGRESS for 2s [ 943.927357] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 57bb6fe9-98c4-47f0-9daa-c424a0c9dfee in Status: SUCCESS [ 943.927618] env[65306]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 57bb6fe9-98c4-47f0-9daa-c424a0c9dfee deletion is rescheduled due to dependency. [ 943.927752] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-57bb6fe9-98c4-47f0-9daa-c424a0c9dfee" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.928032] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-57bb6fe9-98c4-47f0-9daa-c424a0c9dfee" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.928367] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-57bb6fe9-98c4-47f0-9daa-c424a0c9dfee" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.928620] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.928749] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.929015] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.929097] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.929201] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.929350] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('57bb6fe9-98c4-47f0-9daa-c424a0c9dfee',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 944.434506] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('57bb6fe9-98c4-47f0-9daa-c424a0c9dfee',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 944.937202] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('57bb6fe9-98c4-47f0-9daa-c424a0c9dfee',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 945.440059] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.440435] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.440435] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.440727] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.440831] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.440941] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 57bb6fe9-98c4-47f0-9daa-c424a0c9dfee is going to be updated. [ 945.475876] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.476081] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.476120] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.476311] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.476462] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.491876] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 57bb6fe9-98c4-47f0-9daa-c424a0c9dfee in Status: IN_PROGRESS for 2s [ 945.514323] env[65306]: INFO networking_nsxv3.common.synchronization [req-df9d9aad-9fd9-4504-9154-c367d6d3af3d req-84a5fdd0-b73c-492f-b9bf-81190ef36062 tempest-ListServerFiltersTestJSON-702113484 tempest-ListServerFiltersTestJSON-702113484-project-member] Enqueued Resource ID: a3364d7c-b2fd-4f01-932a-1feef0fa76de with Priority: HIGHEST for action security_group_members [ 945.514323] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a3364d7c-b2fd-4f01-932a-1feef0fa76de with Priority: HIGHEST for action security_group_members [ 945.514742] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-a3364d7c-b2fd-4f01-932a-1feef0fa76de taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.514876] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a3364d7c-b2fd-4f01-932a-1feef0fa76de" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.514944] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a3364d7c-b2fd-4f01-932a-1feef0fa76de" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.515166] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a3364d7c-b2fd-4f01-932a-1feef0fa76de" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.515327] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.515466] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.515528] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.515663] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.515994] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.515994] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a3364d7c-b2fd-4f01-932a-1feef0fa76de',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 945.855855] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9e80329d-1fcd-4c50-8991-a90e2a1fbdbc in Status: SUCCESS [ 945.855855] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9e80329d-1fcd-4c50-8991-a90e2a1fbdbc" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.018417] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a3364d7c-b2fd-4f01-932a-1feef0fa76de',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 946.522519] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a3364d7c-b2fd-4f01-932a-1feef0fa76de',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 947.026292] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.026484] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.026564] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.026792] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.026885] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.026988] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a3364d7c-b2fd-4f01-932a-1feef0fa76de is going to be updated. [ 947.055693] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.055851] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.055901] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.056127] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.056301] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.070459] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a3364d7c-b2fd-4f01-932a-1feef0fa76de in Status: IN_PROGRESS for 2s [ 947.504048] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 57bb6fe9-98c4-47f0-9daa-c424a0c9dfee in Status: SUCCESS [ 947.504048] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-57bb6fe9-98c4-47f0-9daa-c424a0c9dfee" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.504048] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-57bb6fe9-98c4-47f0-9daa-c424a0c9dfee" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.504048] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-57bb6fe9-98c4-47f0-9daa-c424a0c9dfee" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.504048] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.504048] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.504048] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.504614] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.504614] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.504614] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-57bb6fe9-98c4-47f0-9daa-c424a0c9dfee" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.504614] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('57bb6fe9-98c4-47f0-9daa-c424a0c9dfee',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 948.009762] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-57bb6fe9-98c4-47f0-9daa-c424a0c9dfee taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.010450] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-57bb6fe9-98c4-47f0-9daa-c424a0c9dfee" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.010450] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-57bb6fe9-98c4-47f0-9daa-c424a0c9dfee" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.010450] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-57bb6fe9-98c4-47f0-9daa-c424a0c9dfee" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.010450] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.010777] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.010777] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.010777] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.010859] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.010942] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-57bb6fe9-98c4-47f0-9daa-c424a0c9dfee" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.011107] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-57bb6fe9-98c4-47f0-9daa-c424a0c9dfee taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.011206] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-57bb6fe9-98c4-47f0-9daa-c424a0c9dfee" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.011428] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-57bb6fe9-98c4-47f0-9daa-c424a0c9dfee" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.011640] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-57bb6fe9-98c4-47f0-9daa-c424a0c9dfee" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.011812] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.011922] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.011989] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.012155] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.012263] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.012357] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-57bb6fe9-98c4-47f0-9daa-c424a0c9dfee" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.012663] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('57bb6fe9-98c4-47f0-9daa-c424a0c9dfee',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 948.470450] env[65306]: INFO networking_nsxv3.common.synchronization [None req-69bde7cd-8915-4304-88d9-40d540c23464 None None] Enqueued Resource ID: e57a7ae6-7918-487f-9dcd-1a21330fba91 with Priority: HIGHEST for action port [ 948.471187] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e57a7ae6-7918-487f-9dcd-1a21330fba91 with Priority: HIGHEST for action port [ 948.471460] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock port-e57a7ae6-7918-487f-9dcd-1a21330fba91 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.471610] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e57a7ae6-7918-487f-9dcd-1a21330fba91" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.471646] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e57a7ae6-7918-487f-9dcd-1a21330fba91" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.471966] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e57a7ae6-7918-487f-9dcd-1a21330fba91" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.471966] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e57a7ae6-7918-487f-9dcd-1a21330fba91',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 948.515194] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 57bb6fe9-98c4-47f0-9daa-c424a0c9dfee: rpc.has_security_group_logging(os_id): False [ 948.534398] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.534627] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.534627] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.534859] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.535297] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.535297] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.535297] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.535527] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.535527] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.535611] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.535953] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.535953] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.535953] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.536165] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.536210] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.536486] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.536611] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.536673] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.536818] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.536892] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.536978] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 57bb6fe9-98c4-47f0-9daa-c424a0c9dfee is going to be updated. [ 948.607077] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.607271] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.607460] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.607541] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.607674] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.623261] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 57bb6fe9-98c4-47f0-9daa-c424a0c9dfee in Status: IN_PROGRESS for 2s [ 948.974073] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e57a7ae6-7918-487f-9dcd-1a21330fba91 [ 948.974372] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.974515] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.974583] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.977017] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.977017] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.977017] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e57a7ae6-7918-487f-9dcd-1a21330fba91 already deleted. [ 948.977017] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e57a7ae6-7918-487f-9dcd-1a21330fba91" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.090029] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a3364d7c-b2fd-4f01-932a-1feef0fa76de in Status: SUCCESS [ 949.090029] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a3364d7c-b2fd-4f01-932a-1feef0fa76de" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.172728] env[65306]: INFO networking_nsxv3.common.synchronization [req-fb577463-5b74-449c-a151-f1c3da7e0a6c req-8e60b3ca-58bb-4d9a-aaed-eac320fb5ec7 tempest-AttachVolumeNegativeTest-723798471 tempest-AttachVolumeNegativeTest-723798471-project-member] Enqueued Resource ID: 979b0e99-7f65-434d-a9e9-1ff018f5b499 with Priority: HIGHEST for action security_group_members [ 949.173459] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 979b0e99-7f65-434d-a9e9-1ff018f5b499 with Priority: HIGHEST for action security_group_members [ 949.173855] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-979b0e99-7f65-434d-a9e9-1ff018f5b499 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.174044] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-979b0e99-7f65-434d-a9e9-1ff018f5b499" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.174165] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-979b0e99-7f65-434d-a9e9-1ff018f5b499" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.174559] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-979b0e99-7f65-434d-a9e9-1ff018f5b499" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.174771] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.174983] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.175119] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.175466] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.175559] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.175653] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('979b0e99-7f65-434d-a9e9-1ff018f5b499',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 949.609788] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock network-638 taken with stack trace [, , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.610032] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "network-638" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.610204] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "network-638" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.610587] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "network-638" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.610882] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.611693] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.611883] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.612162] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.612361] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.612620] env[65306]: DEBUG dogpile.cache.region [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] No value present for key: 'zone-id' {{(pid=65306) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 949.612746] env[65306]: DEBUG dogpile.lock [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] NeedRegenerationException {{(pid=65306) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 949.612864] env[65306]: DEBUG dogpile.lock [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] no value, waiting for create lock {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 949.612974] env[65306]: DEBUG dogpile.lock [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] value creation lock acquired {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 949.613111] env[65306]: DEBUG dogpile.cache.region [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] No value present for key: 'zone-id' {{(pid=65306) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 949.613222] env[65306]: DEBUG dogpile.lock [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Calling creation function for not-yet-present value {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 949.613362] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 949.634233] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 949.634410] env[65306]: DEBUG dogpile.cache.region [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65306) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 949.634566] env[65306]: DEBUG dogpile.lock [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Released creation lock {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 949.634760] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "network-638" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.635101] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock port-4f9dee22-fc26-4052-af2d-2024ef3e66bf taken with stack trace [, , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.635295] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "port-4f9dee22-fc26-4052-af2d-2024ef3e66bf" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.635420] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "port-4f9dee22-fc26-4052-af2d-2024ef3e66bf" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.636034] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "port-4f9dee22-fc26-4052-af2d-2024ef3e66bf" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.636034] env[65306]: DEBUG networking_nsxv3.api.rpc [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4f9dee22-fc26-4052-af2d-2024ef3e66bf',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 949.683338] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.683338] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.683338] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.684825] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.684825] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.684825] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.684825] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.684825] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.684825] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.684825] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.684825] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 979b0e99-7f65-434d-a9e9-1ff018f5b499 already deleted. [ 949.684825] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-979b0e99-7f65-434d-a9e9-1ff018f5b499" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.138890] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.139258] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.139392] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.139603] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.139794] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.139972] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Segment Port 4f9dee22-fc26-4052-af2d-2024ef3e66bf not found, creating... [ 950.140302] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.140439] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.140572] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.140829] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.140975] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.141467] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.141762] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.141860] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.142052] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.142223] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.142981] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Resource: SegmentPort with ID: 4f9dee22-fc26-4052-af2d-2024ef3e66bf is going to be created. [ 950.168812] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.168901] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.168969] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.169348] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.170656] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.170935] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "port-4f9dee22-fc26-4052-af2d-2024ef3e66bf" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.639454] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 57bb6fe9-98c4-47f0-9daa-c424a0c9dfee in Status: SUCCESS [ 950.639454] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-57bb6fe9-98c4-47f0-9daa-c424a0c9dfee" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.941039] env[65306]: INFO networking_nsxv3.common.synchronization [req-fb577463-5b74-449c-a151-f1c3da7e0a6c req-29043029-a5cb-467e-9d8f-b133040262e9 service nova] Enqueued Resource ID: 979b0e99-7f65-434d-a9e9-1ff018f5b499 with Priority: HIGHEST for action security_group_rules [ 950.941307] env[65306]: INFO networking_nsxv3.common.synchronization [req-fb577463-5b74-449c-a151-f1c3da7e0a6c req-29043029-a5cb-467e-9d8f-b133040262e9 service nova] Enqueued Resource ID: 979b0e99-7f65-434d-a9e9-1ff018f5b499 with Priority: HIGHEST for action security_group_members [ 950.941516] env[65306]: INFO networking_nsxv3.common.synchronization [req-fb577463-5b74-449c-a151-f1c3da7e0a6c req-29043029-a5cb-467e-9d8f-b133040262e9 service nova] Enqueued Resource ID: 4f9dee22-fc26-4052-af2d-2024ef3e66bf with Priority: HIGHEST for action port [ 950.942111] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 979b0e99-7f65-434d-a9e9-1ff018f5b499 with Priority: HIGHEST for action security_group_rules [ 950.942285] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 979b0e99-7f65-434d-a9e9-1ff018f5b499 with Priority: HIGHEST for action security_group_members [ 950.942422] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4f9dee22-fc26-4052-af2d-2024ef3e66bf with Priority: HIGHEST for action port [ 950.943248] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock rules-979b0e99-7f65-434d-a9e9-1ff018f5b499 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.943248] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-979b0e99-7f65-434d-a9e9-1ff018f5b499" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.943248] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-979b0e99-7f65-434d-a9e9-1ff018f5b499" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.943673] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-979b0e99-7f65-434d-a9e9-1ff018f5b499" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.943673] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('979b0e99-7f65-434d-a9e9-1ff018f5b499',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 950.944998] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-979b0e99-7f65-434d-a9e9-1ff018f5b499 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.945112] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-979b0e99-7f65-434d-a9e9-1ff018f5b499" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.945207] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-979b0e99-7f65-434d-a9e9-1ff018f5b499" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.945417] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-979b0e99-7f65-434d-a9e9-1ff018f5b499" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.945597] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.945784] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.946199] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.946242] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.946335] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.946427] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('979b0e99-7f65-434d-a9e9-1ff018f5b499',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 950.948011] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock port-4f9dee22-fc26-4052-af2d-2024ef3e66bf taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.949187] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4f9dee22-fc26-4052-af2d-2024ef3e66bf" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.949280] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4f9dee22-fc26-4052-af2d-2024ef3e66bf" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.949440] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4f9dee22-fc26-4052-af2d-2024ef3e66bf" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.949526] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4f9dee22-fc26-4052-af2d-2024ef3e66bf',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 951.096653] env[65306]: INFO networking_nsxv3.common.synchronization [None req-8f39e785-d4b2-4162-bf02-2aaa376c35bb None None] Enqueued Resource ID: c707852f-a426-43c4-af56-f37de1ea28a0 with Priority: HIGHEST for action port [ 951.096653] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c707852f-a426-43c4-af56-f37de1ea28a0 with Priority: HIGHEST for action port [ 951.096941] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock port-c707852f-a426-43c4-af56-f37de1ea28a0 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.097608] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c707852f-a426-43c4-af56-f37de1ea28a0" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.097608] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c707852f-a426-43c4-af56-f37de1ea28a0" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.097608] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c707852f-a426-43c4-af56-f37de1ea28a0" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.097608] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c707852f-a426-43c4-af56-f37de1ea28a0',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 951.457245] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('979b0e99-7f65-434d-a9e9-1ff018f5b499',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 951.458337] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-979b0e99-7f65-434d-a9e9-1ff018f5b499 taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.458453] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-979b0e99-7f65-434d-a9e9-1ff018f5b499" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.458627] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4f9dee22-fc26-4052-af2d-2024ef3e66bf with status ACTIVE [ 951.460269] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.460437] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.460511] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.460752] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.460851] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.460999] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.461420] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.461420] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.461420] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.461609] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.463027] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.463027] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.463027] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.463027] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.463027] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.463286] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4f9dee22-fc26-4052-af2d-2024ef3e66bf is going to be updated. [ 951.489782] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.489986] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.490071] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.490370] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.490547] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.490737] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4f9dee22-fc26-4052-af2d-2024ef3e66bf" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.600727] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c707852f-a426-43c4-af56-f37de1ea28a0 [ 951.600727] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.600727] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.600727] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.601237] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.601435] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.601557] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c707852f-a426-43c4-af56-f37de1ea28a0 already deleted. [ 951.601617] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c707852f-a426-43c4-af56-f37de1ea28a0" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.965354] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('979b0e99-7f65-434d-a9e9-1ff018f5b499',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 952.445503] env[65306]: INFO networking_nsxv3.common.synchronization [None req-3e1c1852-fb6b-4509-bd9f-6265b3f31483 None None] Enqueued Resource ID: bf1c6d8c-d0b7-43f3-8317-17a85909a98d with Priority: HIGHEST for action port [ 952.445503] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bf1c6d8c-d0b7-43f3-8317-17a85909a98d with Priority: HIGHEST for action port [ 952.447411] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock port-bf1c6d8c-d0b7-43f3-8317-17a85909a98d taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.447811] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bf1c6d8c-d0b7-43f3-8317-17a85909a98d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.448027] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bf1c6d8c-d0b7-43f3-8317-17a85909a98d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.448374] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bf1c6d8c-d0b7-43f3-8317-17a85909a98d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.448620] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bf1c6d8c-d0b7-43f3-8317-17a85909a98d',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 952.468087] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.468087] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.468087] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.470085] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.470085] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.470085] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 979b0e99-7f65-434d-a9e9-1ff018f5b499 is going to be created. [ 952.496770] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.496963] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.497089] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.497279] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.497387] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.508203] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 979b0e99-7f65-434d-a9e9-1ff018f5b499 in Status: UNINITIALIZED for 2s [ 952.955457] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port bf1c6d8c-d0b7-43f3-8317-17a85909a98d [ 952.955727] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.955867] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.955943] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.956167] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.956260] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.956356] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:bf1c6d8c-d0b7-43f3-8317-17a85909a98d already deleted. [ 952.956438] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bf1c6d8c-d0b7-43f3-8317-17a85909a98d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.932293] env[65306]: INFO networking_nsxv3.common.synchronization [None req-3383d8dd-b55f-4421-a3e1-3cc56a97d1d0 tempest-AttachVolumeShelveTestJSON-1351401733 tempest-AttachVolumeShelveTestJSON-1351401733-project-member] Enqueued Resource ID: 4ccf00ad-53bf-45d0-a342-260b14c2ccf2 with Priority: HIGHEST for action security_group_rules [ 953.932974] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4ccf00ad-53bf-45d0-a342-260b14c2ccf2 with Priority: HIGHEST for action security_group_rules [ 953.933377] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4ccf00ad-53bf-45d0-a342-260b14c2ccf2 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.933513] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4ccf00ad-53bf-45d0-a342-260b14c2ccf2" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.933622] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4ccf00ad-53bf-45d0-a342-260b14c2ccf2" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.934040] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4ccf00ad-53bf-45d0-a342-260b14c2ccf2" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.934040] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4ccf00ad-53bf-45d0-a342-260b14c2ccf2',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 954.114048] env[65306]: INFO networking_nsxv3.common.synchronization [None req-58f6d05b-7c6e-4855-9103-b5a925d38f6c tempest-AttachVolumeShelveTestJSON-1351401733 tempest-AttachVolumeShelveTestJSON-1351401733-project-member] Enqueued Resource ID: 4ccf00ad-53bf-45d0-a342-260b14c2ccf2 with Priority: HIGHEST for action security_group_rules [ 954.114844] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4ccf00ad-53bf-45d0-a342-260b14c2ccf2 with Priority: HIGHEST for action security_group_rules [ 954.115071] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4ccf00ad-53bf-45d0-a342-260b14c2ccf2 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.115249] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4ccf00ad-53bf-45d0-a342-260b14c2ccf2" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.468079] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.468079] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.468079] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.468079] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.468079] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.468079] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4ccf00ad-53bf-45d0-a342-260b14c2ccf2 already deleted. [ 954.468079] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4ccf00ad-53bf-45d0-a342-260b14c2ccf2" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.468079] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4ccf00ad-53bf-45d0-a342-260b14c2ccf2" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.468079] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4ccf00ad-53bf-45d0-a342-260b14c2ccf2" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.468079] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4ccf00ad-53bf-45d0-a342-260b14c2ccf2',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 954.519151] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 979b0e99-7f65-434d-a9e9-1ff018f5b499 in Status: SUCCESS [ 954.519151] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-979b0e99-7f65-434d-a9e9-1ff018f5b499" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.519649] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-979b0e99-7f65-434d-a9e9-1ff018f5b499" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.519871] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-979b0e99-7f65-434d-a9e9-1ff018f5b499" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.520079] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.520436] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.520436] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.520436] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.520584] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.520584] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-979b0e99-7f65-434d-a9e9-1ff018f5b499" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.520664] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('979b0e99-7f65-434d-a9e9-1ff018f5b499',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 954.991026] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.991356] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.991356] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.991541] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.991635] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.991836] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4ccf00ad-53bf-45d0-a342-260b14c2ccf2 already deleted. [ 954.991836] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4ccf00ad-53bf-45d0-a342-260b14c2ccf2" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.024403] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('979b0e99-7f65-434d-a9e9-1ff018f5b499',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 955.078550] env[65306]: INFO networking_nsxv3.common.synchronization [None req-62ce3402-0bb7-471d-b0ef-e467c6ad30fe None None] Enqueued Resource ID: 4427b140-a675-498a-93f7-90f65477702a with Priority: HIGHEST for action port [ 955.079193] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4427b140-a675-498a-93f7-90f65477702a with Priority: HIGHEST for action port [ 955.079570] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock port-4427b140-a675-498a-93f7-90f65477702a taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.079702] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4427b140-a675-498a-93f7-90f65477702a" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.079760] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4427b140-a675-498a-93f7-90f65477702a" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.080195] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4427b140-a675-498a-93f7-90f65477702a" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.080355] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4427b140-a675-498a-93f7-90f65477702a',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 955.126939] env[65306]: INFO networking_nsxv3.common.synchronization [req-a74e4340-f6e8-4a9b-870b-8f20b4cd05fd req-2318f6f1-6260-47ba-961c-f7166da9e7f0 tempest-ServersAdminTestJSON-2076938379 tempest-ServersAdminTestJSON-2076938379-project-member] Enqueued Resource ID: 56904b3c-38e4-4547-9a1d-cc787c3fef9d with Priority: HIGHEST for action security_group_members [ 955.127876] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 56904b3c-38e4-4547-9a1d-cc787c3fef9d with Priority: HIGHEST for action security_group_members [ 955.128357] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-56904b3c-38e4-4547-9a1d-cc787c3fef9d taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.128595] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-56904b3c-38e4-4547-9a1d-cc787c3fef9d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.128706] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-56904b3c-38e4-4547-9a1d-cc787c3fef9d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.128999] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-56904b3c-38e4-4547-9a1d-cc787c3fef9d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.129237] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.129386] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.129485] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.129705] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.130033] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.130033] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('56904b3c-38e4-4547-9a1d-cc787c3fef9d',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 955.526617] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 979b0e99-7f65-434d-a9e9-1ff018f5b499: rpc.has_security_group_logging(os_id): False [ 955.547794] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.548068] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.548128] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.548453] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.548615] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.549081] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.549149] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.549425] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.549601] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.549688] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.549788] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 979b0e99-7f65-434d-a9e9-1ff018f5b499 is going to be created. [ 955.583254] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4427b140-a675-498a-93f7-90f65477702a [ 955.583504] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.583635] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.583684] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.583906] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.583995] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.584234] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4427b140-a675-498a-93f7-90f65477702a already deleted. [ 955.584234] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4427b140-a675-498a-93f7-90f65477702a" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.626594] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.626811] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.626886] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.627120] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.627311] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.632016] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('56904b3c-38e4-4547-9a1d-cc787c3fef9d',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 955.641177] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock network-705 taken with stack trace [, , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.642237] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "network-705" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.642393] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "network-705" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.642745] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "network-705" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.643581] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.643764] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.643883] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.644139] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.644288] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.644515] env[65306]: DEBUG dogpile.cache.region [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] No value present for key: 'zone-id' {{(pid=65306) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 955.644651] env[65306]: DEBUG dogpile.lock [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] NeedRegenerationException {{(pid=65306) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 955.644765] env[65306]: DEBUG dogpile.lock [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] no value, waiting for create lock {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 955.644882] env[65306]: DEBUG dogpile.lock [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] value creation lock acquired {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 955.644995] env[65306]: DEBUG dogpile.cache.region [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] No value present for key: 'zone-id' {{(pid=65306) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 955.645152] env[65306]: DEBUG dogpile.lock [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Calling creation function for not-yet-present value {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 955.645958] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 955.648578] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 979b0e99-7f65-434d-a9e9-1ff018f5b499 in Status: IN_PROGRESS for 2s [ 955.667740] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 955.667916] env[65306]: DEBUG dogpile.cache.region [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65306) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 955.668076] env[65306]: DEBUG dogpile.lock [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Released creation lock {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 955.668259] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "network-705" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.668577] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock port-ea998b40-86a6-4d36-ac15-9db7a04f758f taken with stack trace [, , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.668772] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "port-ea998b40-86a6-4d36-ac15-9db7a04f758f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.668908] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "port-ea998b40-86a6-4d36-ac15-9db7a04f758f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.669312] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "port-ea998b40-86a6-4d36-ac15-9db7a04f758f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.669836] env[65306]: DEBUG networking_nsxv3.api.rpc [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ea998b40-86a6-4d36-ac15-9db7a04f758f',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 955.969293] env[65306]: INFO networking_nsxv3.common.synchronization [req-fa058639-17f3-4ef6-b773-8d2356850fbd req-b1f38cd8-c0fe-4938-8d1e-89f5a5677536 tempest-MigrationsAdminTest-1842265666 tempest-MigrationsAdminTest-1842265666-project-member] Enqueued Resource ID: 8beaaac6-ba63-44e8-a960-7e228e2e7d37 with Priority: HIGHEST for action security_group_members [ 955.974156] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8beaaac6-ba63-44e8-a960-7e228e2e7d37 with Priority: HIGHEST for action security_group_members [ 955.977048] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-8beaaac6-ba63-44e8-a960-7e228e2e7d37 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.977048] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8beaaac6-ba63-44e8-a960-7e228e2e7d37" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.977048] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8beaaac6-ba63-44e8-a960-7e228e2e7d37" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.977048] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8beaaac6-ba63-44e8-a960-7e228e2e7d37" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.977048] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.977048] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.977048] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.977048] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.977048] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.977048] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8beaaac6-ba63-44e8-a960-7e228e2e7d37',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 956.134998] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('56904b3c-38e4-4547-9a1d-cc787c3fef9d',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 956.172862] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.173234] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.173473] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.173894] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.174149] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.174395] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Segment Port ea998b40-86a6-4d36-ac15-9db7a04f758f not found, creating... [ 956.174810] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.175068] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.175264] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.175625] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.175825] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.176304] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.176556] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.176747] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.177081] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.177293] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.177514] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Resource: SegmentPort with ID: ea998b40-86a6-4d36-ac15-9db7a04f758f is going to be created. [ 956.203913] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.204277] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.204498] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.204946] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.205312] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.205793] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "port-ea998b40-86a6-4d36-ac15-9db7a04f758f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.477809] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.478042] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.478202] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.478550] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.502711] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.503061] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.503214] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.503285] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.503578] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.503693] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.503807] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8beaaac6-ba63-44e8-a960-7e228e2e7d37 is going to be updated. [ 956.536859] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.537044] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.537085] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.537293] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.537436] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.547811] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8beaaac6-ba63-44e8-a960-7e228e2e7d37 in Status: IN_PROGRESS for 2s [ 956.637435] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.637553] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.637603] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.637791] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.637885] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.637987] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 56904b3c-38e4-4547-9a1d-cc787c3fef9d is going to be updated. [ 956.672842] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.673014] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.673094] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.673312] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.673462] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.687259] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 56904b3c-38e4-4547-9a1d-cc787c3fef9d in Status: IN_PROGRESS for 2s [ 956.960278] env[65306]: INFO networking_nsxv3.common.synchronization [req-a74e4340-f6e8-4a9b-870b-8f20b4cd05fd req-61444682-7aab-43fd-b17a-32ab338d8341 service nova] Enqueued Resource ID: 56904b3c-38e4-4547-9a1d-cc787c3fef9d with Priority: HIGHEST for action security_group_rules [ 956.960278] env[65306]: INFO networking_nsxv3.common.synchronization [req-a74e4340-f6e8-4a9b-870b-8f20b4cd05fd req-61444682-7aab-43fd-b17a-32ab338d8341 service nova] Enqueued Resource ID: 56904b3c-38e4-4547-9a1d-cc787c3fef9d with Priority: HIGHEST for action security_group_members [ 956.960590] env[65306]: INFO networking_nsxv3.common.synchronization [req-a74e4340-f6e8-4a9b-870b-8f20b4cd05fd req-61444682-7aab-43fd-b17a-32ab338d8341 service nova] Enqueued Resource ID: ea998b40-86a6-4d36-ac15-9db7a04f758f with Priority: HIGHEST for action port [ 956.960904] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 56904b3c-38e4-4547-9a1d-cc787c3fef9d with Priority: HIGHEST for action security_group_rules [ 956.961061] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 56904b3c-38e4-4547-9a1d-cc787c3fef9d with Priority: HIGHEST for action security_group_members [ 956.961354] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ea998b40-86a6-4d36-ac15-9db7a04f758f with Priority: HIGHEST for action port [ 956.961476] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock rules-56904b3c-38e4-4547-9a1d-cc787c3fef9d taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.961593] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-56904b3c-38e4-4547-9a1d-cc787c3fef9d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.961668] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-56904b3c-38e4-4547-9a1d-cc787c3fef9d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.961859] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-56904b3c-38e4-4547-9a1d-cc787c3fef9d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.961942] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('56904b3c-38e4-4547-9a1d-cc787c3fef9d',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 956.963368] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-56904b3c-38e4-4547-9a1d-cc787c3fef9d taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.963507] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-56904b3c-38e4-4547-9a1d-cc787c3fef9d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.963798] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock port-ea998b40-86a6-4d36-ac15-9db7a04f758f taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.963798] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ea998b40-86a6-4d36-ac15-9db7a04f758f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.963957] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ea998b40-86a6-4d36-ac15-9db7a04f758f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.964035] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ea998b40-86a6-4d36-ac15-9db7a04f758f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.964117] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ea998b40-86a6-4d36-ac15-9db7a04f758f',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 957.466506] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-56904b3c-38e4-4547-9a1d-cc787c3fef9d taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.466784] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-56904b3c-38e4-4547-9a1d-cc787c3fef9d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.466885] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ea998b40-86a6-4d36-ac15-9db7a04f758f with status ACTIVE [ 957.467084] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.467226] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.467226] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.467372] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.467462] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.467630] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.467726] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.467790] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.467970] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.468038] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.468200] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.468297] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.468352] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.468489] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.468560] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.468644] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ea998b40-86a6-4d36-ac15-9db7a04f758f is going to be updated. [ 957.497170] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.497323] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.497395] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.497604] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.497743] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.497907] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ea998b40-86a6-4d36-ac15-9db7a04f758f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.669200] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 979b0e99-7f65-434d-a9e9-1ff018f5b499 in Status: SUCCESS [ 957.669200] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-979b0e99-7f65-434d-a9e9-1ff018f5b499" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.709766] env[65306]: INFO networking_nsxv3.common.synchronization [req-12dc7d42-8a2f-4ccb-90b4-cc5a7242bcde req-6ec14f0a-782a-4cc2-90ba-f3d6c12040ef tempest-ImagesOneServerNegativeTestJSON-105192947 tempest-ImagesOneServerNegativeTestJSON-105192947-project-member] Enqueued Resource ID: aceee07e-3675-474c-96e8-9fe510f1356f with Priority: HIGHEST for action security_group_members [ 957.710204] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aceee07e-3675-474c-96e8-9fe510f1356f with Priority: HIGHEST for action security_group_members [ 957.711994] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-aceee07e-3675-474c-96e8-9fe510f1356f taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.711994] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aceee07e-3675-474c-96e8-9fe510f1356f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.711994] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aceee07e-3675-474c-96e8-9fe510f1356f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.711994] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aceee07e-3675-474c-96e8-9fe510f1356f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.711994] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.711994] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.711994] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.711994] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.711994] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.711994] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('aceee07e-3675-474c-96e8-9fe510f1356f',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 958.139112] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock network-645 taken with stack trace [, , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.139645] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "network-645" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.139645] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "network-645" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.140116] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "network-645" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.140431] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.140629] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.140752] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.141043] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.141188] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.141497] env[65306]: DEBUG dogpile.cache.region [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] No value present for key: 'zone-id' {{(pid=65306) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 958.141909] env[65306]: DEBUG dogpile.lock [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] NeedRegenerationException {{(pid=65306) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 958.141909] env[65306]: DEBUG dogpile.lock [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] no value, waiting for create lock {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 958.141909] env[65306]: DEBUG dogpile.lock [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] value creation lock acquired {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 958.142079] env[65306]: DEBUG dogpile.cache.region [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] No value present for key: 'zone-id' {{(pid=65306) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 958.142248] env[65306]: DEBUG dogpile.lock [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Calling creation function for not-yet-present value {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 958.142510] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 958.172399] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 958.172604] env[65306]: DEBUG dogpile.cache.region [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Cache value generated in 0.030 seconds for key(s): 'zone-id' {{(pid=65306) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 958.172746] env[65306]: DEBUG dogpile.lock [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Released creation lock {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 958.172972] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "network-645" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.173321] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock port-f15b980e-c660-4b9f-a85d-c63946e20394 taken with stack trace [, , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.173817] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "port-f15b980e-c660-4b9f-a85d-c63946e20394" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.173817] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "port-f15b980e-c660-4b9f-a85d-c63946e20394" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.174012] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "port-f15b980e-c660-4b9f-a85d-c63946e20394" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.174185] env[65306]: DEBUG networking_nsxv3.api.rpc [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f15b980e-c660-4b9f-a85d-c63946e20394',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 958.215040] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.215040] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.215040] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.215220] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.215428] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.215794] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.216024] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.216173] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.216493] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.216723] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.217339] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aceee07e-3675-474c-96e8-9fe510f1356f is going to be updated. [ 958.271351] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.271705] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.271758] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.272093] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.272293] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.287071] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aceee07e-3675-474c-96e8-9fe510f1356f in Status: IN_PROGRESS for 2s [ 958.561268] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8beaaac6-ba63-44e8-a960-7e228e2e7d37 in Status: SUCCESS [ 958.561715] env[65306]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8beaaac6-ba63-44e8-a960-7e228e2e7d37 deletion is rescheduled due to dependency. [ 958.561715] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8beaaac6-ba63-44e8-a960-7e228e2e7d37" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.676757] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.677020] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.677171] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.677544] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.677727] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.677907] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Segment Port f15b980e-c660-4b9f-a85d-c63946e20394 not found, creating... [ 958.678330] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.678397] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.678492] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.678755] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.678906] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.681383] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.681383] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.681383] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.681383] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.681383] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.681383] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Resource: SegmentPort with ID: f15b980e-c660-4b9f-a85d-c63946e20394 is going to be created. [ 958.697405] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 56904b3c-38e4-4547-9a1d-cc787c3fef9d in Status: SUCCESS [ 958.697728] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-56904b3c-38e4-4547-9a1d-cc787c3fef9d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.697985] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-56904b3c-38e4-4547-9a1d-cc787c3fef9d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.698571] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-56904b3c-38e4-4547-9a1d-cc787c3fef9d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.698571] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.698715] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.698753] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.699085] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.699085] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.699085] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('56904b3c-38e4-4547-9a1d-cc787c3fef9d',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 958.732467] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.732695] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.734032] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.734032] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.734301] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.734358] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "port-f15b980e-c660-4b9f-a85d-c63946e20394" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.203275] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('56904b3c-38e4-4547-9a1d-cc787c3fef9d',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 959.446794] env[65306]: INFO networking_nsxv3.common.synchronization [req-12dc7d42-8a2f-4ccb-90b4-cc5a7242bcde req-9b735879-8220-4d5d-b452-faf2a68876d5 service nova] Enqueued Resource ID: aceee07e-3675-474c-96e8-9fe510f1356f with Priority: HIGHEST for action security_group_rules [ 959.446877] env[65306]: INFO networking_nsxv3.common.synchronization [req-12dc7d42-8a2f-4ccb-90b4-cc5a7242bcde req-9b735879-8220-4d5d-b452-faf2a68876d5 service nova] Enqueued Resource ID: aceee07e-3675-474c-96e8-9fe510f1356f with Priority: HIGHEST for action security_group_members [ 959.447497] env[65306]: INFO networking_nsxv3.common.synchronization [req-12dc7d42-8a2f-4ccb-90b4-cc5a7242bcde req-9b735879-8220-4d5d-b452-faf2a68876d5 service nova] Enqueued Resource ID: f15b980e-c660-4b9f-a85d-c63946e20394 with Priority: HIGHEST for action port [ 959.447561] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aceee07e-3675-474c-96e8-9fe510f1356f with Priority: HIGHEST for action security_group_rules [ 959.447693] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aceee07e-3675-474c-96e8-9fe510f1356f with Priority: HIGHEST for action security_group_members [ 959.447794] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f15b980e-c660-4b9f-a85d-c63946e20394 with Priority: HIGHEST for action port [ 959.448121] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock rules-aceee07e-3675-474c-96e8-9fe510f1356f taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.448261] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-aceee07e-3675-474c-96e8-9fe510f1356f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.448522] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-aceee07e-3675-474c-96e8-9fe510f1356f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.448522] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-aceee07e-3675-474c-96e8-9fe510f1356f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.448582] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('aceee07e-3675-474c-96e8-9fe510f1356f',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 959.449540] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-aceee07e-3675-474c-96e8-9fe510f1356f taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.449637] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aceee07e-3675-474c-96e8-9fe510f1356f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.449795] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock port-f15b980e-c660-4b9f-a85d-c63946e20394 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.449891] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f15b980e-c660-4b9f-a85d-c63946e20394" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.449927] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f15b980e-c660-4b9f-a85d-c63946e20394" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.450219] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f15b980e-c660-4b9f-a85d-c63946e20394" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.450219] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f15b980e-c660-4b9f-a85d-c63946e20394',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 959.705265] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('56904b3c-38e4-4547-9a1d-cc787c3fef9d',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 959.953354] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-aceee07e-3675-474c-96e8-9fe510f1356f taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.955157] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aceee07e-3675-474c-96e8-9fe510f1356f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.955444] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f15b980e-c660-4b9f-a85d-c63946e20394 with status ACTIVE [ 959.955685] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.955835] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.955883] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.956158] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.956158] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.956370] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.956491] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.956554] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.956722] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.956799] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.957080] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.957565] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.957565] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.957565] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.957565] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.958213] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f15b980e-c660-4b9f-a85d-c63946e20394 is going to be updated. [ 959.985612] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.986907] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.986907] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.986907] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.986907] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.986907] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f15b980e-c660-4b9f-a85d-c63946e20394" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.210321] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.210321] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.210321] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.210321] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.210321] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.210321] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 56904b3c-38e4-4547-9a1d-cc787c3fef9d is going to be updated. [ 960.267063] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.267246] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.267303] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.267532] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.267681] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.292184] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 56904b3c-38e4-4547-9a1d-cc787c3fef9d in Status: IN_PROGRESS for 2s [ 960.302058] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aceee07e-3675-474c-96e8-9fe510f1356f in Status: SUCCESS [ 960.302304] env[65306]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aceee07e-3675-474c-96e8-9fe510f1356f deletion is rescheduled due to dependency. [ 960.302406] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aceee07e-3675-474c-96e8-9fe510f1356f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.302555] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aceee07e-3675-474c-96e8-9fe510f1356f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.302769] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aceee07e-3675-474c-96e8-9fe510f1356f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.302951] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.303085] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.303151] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.303288] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.303727] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.303838] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('aceee07e-3675-474c-96e8-9fe510f1356f',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 960.554942] env[65306]: INFO networking_nsxv3.common.synchronization [req-5147f985-0ffb-44cb-aa5e-09375ce3c37f req-b19e822d-9576-4b51-8eed-2eec6b584307 tempest-ServerActionsTestOtherB-1027609472 tempest-ServerActionsTestOtherB-1027609472-project-member] Enqueued Resource ID: 37349b8b-c2c1-4141-8b10-752c27492cbd with Priority: HIGHEST for action security_group_members [ 960.554942] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 37349b8b-c2c1-4141-8b10-752c27492cbd with Priority: HIGHEST for action security_group_members [ 960.554942] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-37349b8b-c2c1-4141-8b10-752c27492cbd taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.554942] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-37349b8b-c2c1-4141-8b10-752c27492cbd" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.554942] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-37349b8b-c2c1-4141-8b10-752c27492cbd" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.554942] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-37349b8b-c2c1-4141-8b10-752c27492cbd" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.555952] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.556258] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.556465] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.556760] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.556972] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.557200] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('37349b8b-c2c1-4141-8b10-752c27492cbd',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 960.807400] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('aceee07e-3675-474c-96e8-9fe510f1356f',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 961.059394] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.059562] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.059639] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.059855] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.064402] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock network-221 taken with stack trace [, , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.064643] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "network-221" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.064716] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "network-221" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.064984] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "network-221" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.065380] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.065482] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.065540] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.065763] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.065930] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.066173] env[65306]: DEBUG dogpile.cache.region [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] No value present for key: 'zone-id' {{(pid=65306) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 961.066298] env[65306]: DEBUG dogpile.lock [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] NeedRegenerationException {{(pid=65306) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 961.066417] env[65306]: DEBUG dogpile.lock [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] no value, waiting for create lock {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 961.066627] env[65306]: DEBUG dogpile.lock [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] value creation lock acquired {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 961.066688] env[65306]: DEBUG dogpile.cache.region [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] No value present for key: 'zone-id' {{(pid=65306) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 961.066772] env[65306]: DEBUG dogpile.lock [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Calling creation function for not-yet-present value {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 961.066926] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 961.089716] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 961.092077] env[65306]: DEBUG dogpile.cache.region [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=65306) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 961.092284] env[65306]: DEBUG dogpile.lock [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Released creation lock {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 961.092445] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "network-221" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.092773] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock port-22728c9b-ccf6-4dbb-8ef0-7f7951270aa0 taken with stack trace [, , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.092948] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "port-22728c9b-ccf6-4dbb-8ef0-7f7951270aa0" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.093324] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "port-22728c9b-ccf6-4dbb-8ef0-7f7951270aa0" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.093627] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "port-22728c9b-ccf6-4dbb-8ef0-7f7951270aa0" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.093787] env[65306]: DEBUG networking_nsxv3.api.rpc [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('22728c9b-ccf6-4dbb-8ef0-7f7951270aa0',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 961.097334] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.097610] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.097760] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.097847] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.098083] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.098188] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.098293] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 37349b8b-c2c1-4141-8b10-752c27492cbd is going to be updated. [ 961.133765] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.133765] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.133765] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.134070] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.134200] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.145588] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 37349b8b-c2c1-4141-8b10-752c27492cbd in Status: IN_PROGRESS for 2s [ 961.310541] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('aceee07e-3675-474c-96e8-9fe510f1356f',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 961.601350] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.601620] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.601774] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.602110] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.602293] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.602511] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Segment Port 22728c9b-ccf6-4dbb-8ef0-7f7951270aa0 not found, creating... [ 961.602832] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.603060] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.603196] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.603442] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.603592] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.603929] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.604884] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.605064] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.605423] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.605572] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.605728] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Resource: SegmentPort with ID: 22728c9b-ccf6-4dbb-8ef0-7f7951270aa0 is going to be created. [ 961.639658] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.639890] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.640096] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.640438] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.640737] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.641020] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "port-22728c9b-ccf6-4dbb-8ef0-7f7951270aa0" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.812890] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.813280] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.813280] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.813451] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.813577] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.813804] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aceee07e-3675-474c-96e8-9fe510f1356f is going to be updated. [ 961.848750] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.848750] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.848750] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.848962] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.849136] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.860086] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aceee07e-3675-474c-96e8-9fe510f1356f in Status: IN_PROGRESS for 2s [ 962.304875] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 56904b3c-38e4-4547-9a1d-cc787c3fef9d in Status: SUCCESS [ 962.304875] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-56904b3c-38e4-4547-9a1d-cc787c3fef9d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.304875] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-56904b3c-38e4-4547-9a1d-cc787c3fef9d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.304875] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-56904b3c-38e4-4547-9a1d-cc787c3fef9d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.304875] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.304875] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.304875] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.304875] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.305413] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.305413] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-56904b3c-38e4-4547-9a1d-cc787c3fef9d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.305413] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('56904b3c-38e4-4547-9a1d-cc787c3fef9d',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 962.499154] env[65306]: INFO networking_nsxv3.common.synchronization [req-5147f985-0ffb-44cb-aa5e-09375ce3c37f req-a1427cf7-04ca-4347-a904-bd73990a696f service nova] Enqueued Resource ID: 37349b8b-c2c1-4141-8b10-752c27492cbd with Priority: HIGHEST for action security_group_rules [ 962.499154] env[65306]: INFO networking_nsxv3.common.synchronization [req-5147f985-0ffb-44cb-aa5e-09375ce3c37f req-a1427cf7-04ca-4347-a904-bd73990a696f service nova] Enqueued Resource ID: 37349b8b-c2c1-4141-8b10-752c27492cbd with Priority: HIGHEST for action security_group_members [ 962.499154] env[65306]: INFO networking_nsxv3.common.synchronization [req-5147f985-0ffb-44cb-aa5e-09375ce3c37f req-a1427cf7-04ca-4347-a904-bd73990a696f service nova] Enqueued Resource ID: 22728c9b-ccf6-4dbb-8ef0-7f7951270aa0 with Priority: HIGHEST for action port [ 962.499154] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 37349b8b-c2c1-4141-8b10-752c27492cbd with Priority: HIGHEST for action security_group_rules [ 962.499154] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 37349b8b-c2c1-4141-8b10-752c27492cbd with Priority: HIGHEST for action security_group_members [ 962.499154] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 22728c9b-ccf6-4dbb-8ef0-7f7951270aa0 with Priority: HIGHEST for action port [ 962.499154] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock rules-37349b8b-c2c1-4141-8b10-752c27492cbd taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.499154] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-37349b8b-c2c1-4141-8b10-752c27492cbd" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.499154] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-37349b8b-c2c1-4141-8b10-752c27492cbd" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.499154] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-37349b8b-c2c1-4141-8b10-752c27492cbd" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.499154] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('37349b8b-c2c1-4141-8b10-752c27492cbd',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 962.502450] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-37349b8b-c2c1-4141-8b10-752c27492cbd taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.502450] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-37349b8b-c2c1-4141-8b10-752c27492cbd" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.502610] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock port-22728c9b-ccf6-4dbb-8ef0-7f7951270aa0 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.502719] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-22728c9b-ccf6-4dbb-8ef0-7f7951270aa0" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.502766] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-22728c9b-ccf6-4dbb-8ef0-7f7951270aa0" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.503149] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-22728c9b-ccf6-4dbb-8ef0-7f7951270aa0" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.503149] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('22728c9b-ccf6-4dbb-8ef0-7f7951270aa0',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 962.808194] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-56904b3c-38e4-4547-9a1d-cc787c3fef9d taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.808426] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-56904b3c-38e4-4547-9a1d-cc787c3fef9d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.808467] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-56904b3c-38e4-4547-9a1d-cc787c3fef9d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.808735] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-56904b3c-38e4-4547-9a1d-cc787c3fef9d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.808905] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.809067] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.809759] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.809759] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.810749] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.810888] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-56904b3c-38e4-4547-9a1d-cc787c3fef9d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.811048] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-56904b3c-38e4-4547-9a1d-cc787c3fef9d taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.811154] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-56904b3c-38e4-4547-9a1d-cc787c3fef9d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.811229] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-56904b3c-38e4-4547-9a1d-cc787c3fef9d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.811473] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-56904b3c-38e4-4547-9a1d-cc787c3fef9d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.811652] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.811781] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.811842] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.811992] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.812085] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.812171] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-56904b3c-38e4-4547-9a1d-cc787c3fef9d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.812263] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('56904b3c-38e4-4547-9a1d-cc787c3fef9d',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 963.004532] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-37349b8b-c2c1-4141-8b10-752c27492cbd taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.004864] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-37349b8b-c2c1-4141-8b10-752c27492cbd" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.006070] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 22728c9b-ccf6-4dbb-8ef0-7f7951270aa0 with status ACTIVE [ 963.006246] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.006579] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.006579] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.006813] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.006899] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.007082] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.007268] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.007268] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.007385] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.007488] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.007675] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.007811] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.007849] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.007961] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.008064] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.008151] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 22728c9b-ccf6-4dbb-8ef0-7f7951270aa0 is going to be updated. [ 963.030218] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.030218] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.030218] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.030463] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.030463] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.030627] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-22728c9b-ccf6-4dbb-8ef0-7f7951270aa0" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.162502] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 37349b8b-c2c1-4141-8b10-752c27492cbd in Status: SUCCESS [ 963.164163] env[65306]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 37349b8b-c2c1-4141-8b10-752c27492cbd deletion is rescheduled due to dependency. [ 963.164163] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-37349b8b-c2c1-4141-8b10-752c27492cbd" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.164163] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-37349b8b-c2c1-4141-8b10-752c27492cbd" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.164163] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-37349b8b-c2c1-4141-8b10-752c27492cbd" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.164163] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.164163] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.164163] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.164163] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.164163] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.164163] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('37349b8b-c2c1-4141-8b10-752c27492cbd',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 963.315646] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 56904b3c-38e4-4547-9a1d-cc787c3fef9d: rpc.has_security_group_logging(os_id): False [ 963.349834] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.350085] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.350228] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.350516] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.350723] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.350990] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.351150] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.351254] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.351518] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.351649] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.352093] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.352178] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.352242] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.352640] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.352640] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.352735] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.352813] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.352934] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.353056] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.353137] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.354076] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 56904b3c-38e4-4547-9a1d-cc787c3fef9d is going to be updated. [ 963.422305] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.422516] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.422583] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.422871] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.423119] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.440602] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 56904b3c-38e4-4547-9a1d-cc787c3fef9d in Status: IN_PROGRESS for 2s [ 963.668941] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('37349b8b-c2c1-4141-8b10-752c27492cbd',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 963.875656] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aceee07e-3675-474c-96e8-9fe510f1356f in Status: SUCCESS [ 963.875915] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aceee07e-3675-474c-96e8-9fe510f1356f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.876528] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aceee07e-3675-474c-96e8-9fe510f1356f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.876528] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aceee07e-3675-474c-96e8-9fe510f1356f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.876652] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.876712] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.876745] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.877017] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.877111] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.877202] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aceee07e-3675-474c-96e8-9fe510f1356f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.877294] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('aceee07e-3675-474c-96e8-9fe510f1356f',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 964.172840] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('37349b8b-c2c1-4141-8b10-752c27492cbd',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 964.380281] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-aceee07e-3675-474c-96e8-9fe510f1356f taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.380518] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aceee07e-3675-474c-96e8-9fe510f1356f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.380606] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aceee07e-3675-474c-96e8-9fe510f1356f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.381729] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aceee07e-3675-474c-96e8-9fe510f1356f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.382052] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.382149] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.382201] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.382525] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.382663] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.382796] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aceee07e-3675-474c-96e8-9fe510f1356f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.383123] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-aceee07e-3675-474c-96e8-9fe510f1356f taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.383268] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aceee07e-3675-474c-96e8-9fe510f1356f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.383374] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aceee07e-3675-474c-96e8-9fe510f1356f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.383596] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aceee07e-3675-474c-96e8-9fe510f1356f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.383788] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.383949] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.384034] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.384257] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.384356] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.384439] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aceee07e-3675-474c-96e8-9fe510f1356f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.384556] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('aceee07e-3675-474c-96e8-9fe510f1356f',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 964.674906] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.675128] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.675196] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.675418] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.675577] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.675661] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 37349b8b-c2c1-4141-8b10-752c27492cbd is going to be updated. [ 964.756043] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.756366] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.756366] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.756605] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.756831] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.778648] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 37349b8b-c2c1-4141-8b10-752c27492cbd in Status: IN_PROGRESS for 2s [ 964.888435] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for aceee07e-3675-474c-96e8-9fe510f1356f: rpc.has_security_group_logging(os_id): False [ 964.916407] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.916407] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.916407] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.916407] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.916407] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.917108] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.917108] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.917108] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.917419] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.917419] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.917924] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.917924] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.917924] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.918160] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.918160] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.918462] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.918462] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.918642] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.918642] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.918732] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.918894] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: aceee07e-3675-474c-96e8-9fe510f1356f is going to be updated. [ 964.995301] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.995535] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.995535] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.995755] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.996106] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.019250] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: aceee07e-3675-474c-96e8-9fe510f1356f in Status: IN_PROGRESS for 2s [ 965.456972] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 56904b3c-38e4-4547-9a1d-cc787c3fef9d in Status: SUCCESS [ 965.457316] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-56904b3c-38e4-4547-9a1d-cc787c3fef9d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.794201] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 37349b8b-c2c1-4141-8b10-752c27492cbd in Status: SUCCESS [ 966.794587] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-37349b8b-c2c1-4141-8b10-752c27492cbd" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.794587] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-37349b8b-c2c1-4141-8b10-752c27492cbd" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.794823] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-37349b8b-c2c1-4141-8b10-752c27492cbd" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.795087] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.795219] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.795290] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.795465] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.795561] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.795637] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-37349b8b-c2c1-4141-8b10-752c27492cbd" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.795735] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('37349b8b-c2c1-4141-8b10-752c27492cbd',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 967.048062] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: aceee07e-3675-474c-96e8-9fe510f1356f in Status: SUCCESS [ 967.048380] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-aceee07e-3675-474c-96e8-9fe510f1356f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.300069] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('37349b8b-c2c1-4141-8b10-752c27492cbd',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 967.499206] env[65306]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 967.499374] env[65306]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 967.802136] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 37349b8b-c2c1-4141-8b10-752c27492cbd: rpc.has_security_group_logging(os_id): False [ 967.824827] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.825061] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.825215] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.825547] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.825675] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.826113] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.826297] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.826519] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.826823] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.826906] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.826977] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 37349b8b-c2c1-4141-8b10-752c27492cbd is going to be updated. [ 967.933753] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.934427] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.934546] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.934865] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.935497] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.954019] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 37349b8b-c2c1-4141-8b10-752c27492cbd in Status: IN_PROGRESS for 2s [ 969.193192] env[65306]: INFO networking_nsxv3.common.synchronization [req-f4113f62-e647-4e60-985f-46fce70f45fc req-46433793-5968-47f6-bda3-184625477446 tempest-DeleteServersTestJSON-1340326246 tempest-DeleteServersTestJSON-1340326246-project-member] Enqueued Resource ID: d82bad56-9830-4c7d-9763-6d8a05e0998c with Priority: HIGHEST for action security_group_members [ 969.193904] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d82bad56-9830-4c7d-9763-6d8a05e0998c with Priority: HIGHEST for action security_group_members [ 969.194311] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-d82bad56-9830-4c7d-9763-6d8a05e0998c taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.194429] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d82bad56-9830-4c7d-9763-6d8a05e0998c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.194511] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d82bad56-9830-4c7d-9763-6d8a05e0998c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.194900] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d82bad56-9830-4c7d-9763-6d8a05e0998c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.195117] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.195243] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.195315] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.195545] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.195660] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.195782] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d82bad56-9830-4c7d-9763-6d8a05e0998c',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 969.619901] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock network-591 taken with stack trace [, , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.620637] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "network-591" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.620637] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "network-591" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.620637] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "network-591" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.620801] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.620959] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.621418] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.621862] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.622037] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.622303] env[65306]: DEBUG dogpile.cache.region [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] No value present for key: 'zone-id' {{(pid=65306) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 969.622392] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] NeedRegenerationException {{(pid=65306) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 969.622693] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] no value, waiting for create lock {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 969.622693] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] value creation lock acquired {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 969.622693] env[65306]: DEBUG dogpile.cache.region [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] No value present for key: 'zone-id' {{(pid=65306) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 969.622832] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Calling creation function for not-yet-present value {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 969.623191] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 969.647479] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 969.647479] env[65306]: DEBUG dogpile.cache.region [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65306) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 969.647479] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Released creation lock {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 969.647479] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "network-591" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.647479] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock port-36b873bc-8935-4401-8a41-6216153c1db9 taken with stack trace [, , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.647479] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "port-36b873bc-8935-4401-8a41-6216153c1db9" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.647479] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "port-36b873bc-8935-4401-8a41-6216153c1db9" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.648942] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "port-36b873bc-8935-4401-8a41-6216153c1db9" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.650171] env[65306]: DEBUG networking_nsxv3.api.rpc [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('36b873bc-8935-4401-8a41-6216153c1db9',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 969.699156] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.699723] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.700175] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.700532] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.701768] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.702153] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.702892] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.702972] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.703197] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.703297] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.703510] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d82bad56-9830-4c7d-9763-6d8a05e0998c already deleted. [ 969.703608] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d82bad56-9830-4c7d-9763-6d8a05e0998c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.972212] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 37349b8b-c2c1-4141-8b10-752c27492cbd in Status: SUCCESS [ 969.972212] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-37349b8b-c2c1-4141-8b10-752c27492cbd" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.153280] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.153473] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.153473] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.154040] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.154040] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.154199] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Segment Port 36b873bc-8935-4401-8a41-6216153c1db9 not found, creating... [ 970.154387] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.154558] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.154944] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.154944] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.155068] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.155464] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.155617] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.155707] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.155922] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.156113] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.156221] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Resource: SegmentPort with ID: 36b873bc-8935-4401-8a41-6216153c1db9 is going to be created. [ 970.188033] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.188241] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.188297] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.188606] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.188983] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.192231] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "port-36b873bc-8935-4401-8a41-6216153c1db9" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.906308] env[65306]: INFO networking_nsxv3.common.synchronization [req-f4113f62-e647-4e60-985f-46fce70f45fc req-68d0fc1c-e28d-4d9c-a4e4-6d509156d426 service nova] Enqueued Resource ID: d82bad56-9830-4c7d-9763-6d8a05e0998c with Priority: HIGHEST for action security_group_rules [ 970.906308] env[65306]: INFO networking_nsxv3.common.synchronization [req-f4113f62-e647-4e60-985f-46fce70f45fc req-68d0fc1c-e28d-4d9c-a4e4-6d509156d426 service nova] Enqueued Resource ID: d82bad56-9830-4c7d-9763-6d8a05e0998c with Priority: HIGHEST for action security_group_members [ 970.906615] env[65306]: INFO networking_nsxv3.common.synchronization [req-f4113f62-e647-4e60-985f-46fce70f45fc req-68d0fc1c-e28d-4d9c-a4e4-6d509156d426 service nova] Enqueued Resource ID: 36b873bc-8935-4401-8a41-6216153c1db9 with Priority: HIGHEST for action port [ 970.907248] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d82bad56-9830-4c7d-9763-6d8a05e0998c with Priority: HIGHEST for action security_group_rules [ 970.907790] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d82bad56-9830-4c7d-9763-6d8a05e0998c with Priority: HIGHEST for action security_group_members [ 970.907790] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 36b873bc-8935-4401-8a41-6216153c1db9 with Priority: HIGHEST for action port [ 970.907944] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d82bad56-9830-4c7d-9763-6d8a05e0998c taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.908077] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d82bad56-9830-4c7d-9763-6d8a05e0998c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.908130] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d82bad56-9830-4c7d-9763-6d8a05e0998c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.910411] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d82bad56-9830-4c7d-9763-6d8a05e0998c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.910411] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d82bad56-9830-4c7d-9763-6d8a05e0998c',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 970.910685] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-d82bad56-9830-4c7d-9763-6d8a05e0998c taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.910685] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d82bad56-9830-4c7d-9763-6d8a05e0998c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.910773] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d82bad56-9830-4c7d-9763-6d8a05e0998c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.911362] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d82bad56-9830-4c7d-9763-6d8a05e0998c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.911597] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.911734] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.911802] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.911960] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.912068] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.912164] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d82bad56-9830-4c7d-9763-6d8a05e0998c',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 970.913871] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock port-36b873bc-8935-4401-8a41-6216153c1db9 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.913871] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-36b873bc-8935-4401-8a41-6216153c1db9" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.913871] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-36b873bc-8935-4401-8a41-6216153c1db9" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.913871] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-36b873bc-8935-4401-8a41-6216153c1db9" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.913871] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('36b873bc-8935-4401-8a41-6216153c1db9',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 971.412313] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-d82bad56-9830-4c7d-9763-6d8a05e0998c taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.412313] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d82bad56-9830-4c7d-9763-6d8a05e0998c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.414430] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d82bad56-9830-4c7d-9763-6d8a05e0998c',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 971.417237] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 36b873bc-8935-4401-8a41-6216153c1db9 with status ACTIVE [ 971.417477] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.417607] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.417691] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.417942] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.418157] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.419481] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.419481] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.419638] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.419730] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.419873] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.420324] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.420324] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.420324] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.420525] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.420626] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.421229] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 36b873bc-8935-4401-8a41-6216153c1db9 is going to be updated. [ 971.447458] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.447656] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.447656] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.447907] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.448066] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.448241] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-36b873bc-8935-4401-8a41-6216153c1db9" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.812823] env[65306]: INFO networking_nsxv3.common.synchronization [req-07991faa-d51d-479d-aafc-bfc519de08b4 req-d32e51ce-1333-438d-ae99-da0c953e886a tempest-ServersNegativeTestJSON-1568308048 tempest-ServersNegativeTestJSON-1568308048-project-member] Enqueued Resource ID: 7c868cfd-e55d-4976-95db-5b3f64c76a5f with Priority: HIGHEST for action security_group_members [ 971.813447] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7c868cfd-e55d-4976-95db-5b3f64c76a5f with Priority: HIGHEST for action security_group_members [ 971.814193] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-7c868cfd-e55d-4976-95db-5b3f64c76a5f taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.814193] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7c868cfd-e55d-4976-95db-5b3f64c76a5f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.814193] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7c868cfd-e55d-4976-95db-5b3f64c76a5f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.815576] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7c868cfd-e55d-4976-95db-5b3f64c76a5f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.815668] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.815800] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.815979] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.816068] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.816194] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.816266] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7c868cfd-e55d-4976-95db-5b3f64c76a5f',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 972.005765] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d82bad56-9830-4c7d-9763-6d8a05e0998c',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 972.270239] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock network-715 taken with stack trace [, , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.270239] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "network-715" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.270239] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "network-715" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.270545] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "network-715" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.270719] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.270889] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.270979] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.271213] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.271433] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.271655] env[65306]: DEBUG dogpile.cache.region [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] No value present for key: 'zone-id' {{(pid=65306) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 972.271781] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] NeedRegenerationException {{(pid=65306) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 972.271889] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] no value, waiting for create lock {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 972.271995] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] value creation lock acquired {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 972.272117] env[65306]: DEBUG dogpile.cache.region [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] No value present for key: 'zone-id' {{(pid=65306) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 972.272252] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Calling creation function for not-yet-present value {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 972.272343] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 972.297214] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 972.297214] env[65306]: DEBUG dogpile.cache.region [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65306) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 972.297214] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Released creation lock {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 972.297214] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "network-715" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.297214] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock port-44163341-e42e-41dc-8eb5-3406072fe562 taken with stack trace [, , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.297214] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "port-44163341-e42e-41dc-8eb5-3406072fe562" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.297214] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "port-44163341-e42e-41dc-8eb5-3406072fe562" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.297591] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "port-44163341-e42e-41dc-8eb5-3406072fe562" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.297746] env[65306]: DEBUG networking_nsxv3.api.rpc [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('44163341-e42e-41dc-8eb5-3406072fe562',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 972.321066] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7c868cfd-e55d-4976-95db-5b3f64c76a5f',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 972.510942] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.510942] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.510942] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.510942] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.510942] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.511309] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d82bad56-9830-4c7d-9763-6d8a05e0998c is going to be created. [ 972.537610] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.537758] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.537841] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.538052] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.538200] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.549020] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d82bad56-9830-4c7d-9763-6d8a05e0998c in Status: UNINITIALIZED for 2s [ 972.635568] env[65306]: INFO networking_nsxv3.common.synchronization [req-21b6617e-058e-49d7-8dd7-4479b46500a8 req-800e4ae8-14bb-4a7a-a7e2-0368369f162e tempest-ImagesOneServerNegativeTestJSON-105192947 tempest-ImagesOneServerNegativeTestJSON-105192947-project-member] Enqueued Resource ID: aceee07e-3675-474c-96e8-9fe510f1356f with Priority: HIGHEST for action security_group_members [ 972.636138] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aceee07e-3675-474c-96e8-9fe510f1356f with Priority: HIGHEST for action security_group_members [ 972.636454] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-aceee07e-3675-474c-96e8-9fe510f1356f taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.636575] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aceee07e-3675-474c-96e8-9fe510f1356f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.636642] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aceee07e-3675-474c-96e8-9fe510f1356f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.636851] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aceee07e-3675-474c-96e8-9fe510f1356f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.636990] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.637234] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.637299] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.637456] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.637542] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.637663] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('aceee07e-3675-474c-96e8-9fe510f1356f',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 972.800525] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.800757] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.800890] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.801190] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.801360] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.803265] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Segment Port 44163341-e42e-41dc-8eb5-3406072fe562 not found, creating... [ 972.803265] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.803265] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.803265] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.803265] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.803265] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.804520] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.804520] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.804520] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.804520] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.804520] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.804883] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Resource: SegmentPort with ID: 44163341-e42e-41dc-8eb5-3406072fe562 is going to be created. [ 972.821807] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7c868cfd-e55d-4976-95db-5b3f64c76a5f',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 972.825750] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.825967] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.826334] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.826410] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.826622] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.826887] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "port-44163341-e42e-41dc-8eb5-3406072fe562" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.140588] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.141526] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.141526] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.141526] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.141526] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.141526] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.141967] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.141967] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.141967] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.141967] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.142188] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aceee07e-3675-474c-96e8-9fe510f1356f is going to be updated. [ 973.178353] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.178625] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.178625] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.178762] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.178901] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.189809] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aceee07e-3675-474c-96e8-9fe510f1356f in Status: IN_PROGRESS for 2s [ 973.324492] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.324619] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.324686] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.324916] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.325015] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.325126] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7c868cfd-e55d-4976-95db-5b3f64c76a5f is going to be updated. [ 973.386065] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.386247] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.386371] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.386666] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.386884] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.400645] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7c868cfd-e55d-4976-95db-5b3f64c76a5f in Status: IN_PROGRESS for 2s [ 973.599477] env[65306]: INFO networking_nsxv3.common.synchronization [req-07991faa-d51d-479d-aafc-bfc519de08b4 req-458391ee-ba00-4455-8fc5-4e666b95b480 service nova] Enqueued Resource ID: 7c868cfd-e55d-4976-95db-5b3f64c76a5f with Priority: HIGHEST for action security_group_rules [ 973.600029] env[65306]: INFO networking_nsxv3.common.synchronization [req-07991faa-d51d-479d-aafc-bfc519de08b4 req-458391ee-ba00-4455-8fc5-4e666b95b480 service nova] Enqueued Resource ID: 7c868cfd-e55d-4976-95db-5b3f64c76a5f with Priority: HIGHEST for action security_group_members [ 973.600218] env[65306]: INFO networking_nsxv3.common.synchronization [req-07991faa-d51d-479d-aafc-bfc519de08b4 req-458391ee-ba00-4455-8fc5-4e666b95b480 service nova] Enqueued Resource ID: 44163341-e42e-41dc-8eb5-3406072fe562 with Priority: HIGHEST for action port [ 973.600759] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7c868cfd-e55d-4976-95db-5b3f64c76a5f with Priority: HIGHEST for action security_group_rules [ 973.600878] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7c868cfd-e55d-4976-95db-5b3f64c76a5f with Priority: HIGHEST for action security_group_members [ 973.600976] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 44163341-e42e-41dc-8eb5-3406072fe562 with Priority: HIGHEST for action port [ 973.601284] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7c868cfd-e55d-4976-95db-5b3f64c76a5f taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.601437] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7c868cfd-e55d-4976-95db-5b3f64c76a5f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.601516] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7c868cfd-e55d-4976-95db-5b3f64c76a5f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.601725] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7c868cfd-e55d-4976-95db-5b3f64c76a5f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.601829] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7c868cfd-e55d-4976-95db-5b3f64c76a5f',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 973.605998] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-7c868cfd-e55d-4976-95db-5b3f64c76a5f taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.605998] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7c868cfd-e55d-4976-95db-5b3f64c76a5f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.605998] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock port-44163341-e42e-41dc-8eb5-3406072fe562 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.605998] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-44163341-e42e-41dc-8eb5-3406072fe562" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.605998] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-44163341-e42e-41dc-8eb5-3406072fe562" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.605998] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-44163341-e42e-41dc-8eb5-3406072fe562" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.605998] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('44163341-e42e-41dc-8eb5-3406072fe562',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 974.106958] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-7c868cfd-e55d-4976-95db-5b3f64c76a5f taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.106958] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7c868cfd-e55d-4976-95db-5b3f64c76a5f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.108526] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 44163341-e42e-41dc-8eb5-3406072fe562 with status ACTIVE [ 974.108526] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.108526] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.108526] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.108526] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.108526] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.108526] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.108526] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.109089] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.109392] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.109531] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.109829] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.110023] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.110134] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.110278] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.110359] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.110454] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 44163341-e42e-41dc-8eb5-3406072fe562 is going to be updated. [ 974.135671] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.135846] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.135926] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.136146] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.136297] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.136474] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-44163341-e42e-41dc-8eb5-3406072fe562" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.560866] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d82bad56-9830-4c7d-9763-6d8a05e0998c in Status: SUCCESS [ 974.561271] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d82bad56-9830-4c7d-9763-6d8a05e0998c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.561359] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d82bad56-9830-4c7d-9763-6d8a05e0998c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.561548] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d82bad56-9830-4c7d-9763-6d8a05e0998c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.561742] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.561878] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.561941] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.562118] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.562177] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.562227] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d82bad56-9830-4c7d-9763-6d8a05e0998c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.562328] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d82bad56-9830-4c7d-9763-6d8a05e0998c',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 975.066635] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-d82bad56-9830-4c7d-9763-6d8a05e0998c taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.066826] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d82bad56-9830-4c7d-9763-6d8a05e0998c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.066826] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d82bad56-9830-4c7d-9763-6d8a05e0998c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.066979] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d82bad56-9830-4c7d-9763-6d8a05e0998c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.067200] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.067309] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.067459] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.067593] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.067686] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.067774] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d82bad56-9830-4c7d-9763-6d8a05e0998c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.067926] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-d82bad56-9830-4c7d-9763-6d8a05e0998c taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.068032] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d82bad56-9830-4c7d-9763-6d8a05e0998c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.068093] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d82bad56-9830-4c7d-9763-6d8a05e0998c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.068236] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d82bad56-9830-4c7d-9763-6d8a05e0998c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.068373] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.068463] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.068609] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.068683] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.068761] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.068842] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d82bad56-9830-4c7d-9763-6d8a05e0998c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.068931] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d82bad56-9830-4c7d-9763-6d8a05e0998c',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 975.203039] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aceee07e-3675-474c-96e8-9fe510f1356f in Status: SUCCESS [ 975.203954] env[65306]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aceee07e-3675-474c-96e8-9fe510f1356f deletion is rescheduled due to dependency. [ 975.203954] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aceee07e-3675-474c-96e8-9fe510f1356f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.412336] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7c868cfd-e55d-4976-95db-5b3f64c76a5f in Status: SUCCESS [ 975.412336] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7c868cfd-e55d-4976-95db-5b3f64c76a5f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.412520] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7c868cfd-e55d-4976-95db-5b3f64c76a5f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.414222] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7c868cfd-e55d-4976-95db-5b3f64c76a5f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.414222] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.414222] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.414222] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.414222] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.414222] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.414222] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7c868cfd-e55d-4976-95db-5b3f64c76a5f',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 975.575474] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d82bad56-9830-4c7d-9763-6d8a05e0998c: rpc.has_security_group_logging(os_id): False [ 975.596388] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.596623] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.596670] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.596989] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.597146] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.597367] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.597513] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.597612] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.597845] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.597964] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.598303] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.598439] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.598535] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.598732] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.598829] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.599150] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.599316] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.599449] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.599621] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.599747] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.599849] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d82bad56-9830-4c7d-9763-6d8a05e0998c is going to be created. [ 975.692206] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.692659] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.692659] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.692877] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.693369] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.714271] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d82bad56-9830-4c7d-9763-6d8a05e0998c in Status: IN_PROGRESS for 2s [ 975.916166] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7c868cfd-e55d-4976-95db-5b3f64c76a5f',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 976.418461] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7c868cfd-e55d-4976-95db-5b3f64c76a5f',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 976.921629] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.921946] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.921946] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.922111] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.922285] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.922334] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7c868cfd-e55d-4976-95db-5b3f64c76a5f is going to be updated. [ 976.958231] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.958424] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.958490] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.958664] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.958809] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.970048] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7c868cfd-e55d-4976-95db-5b3f64c76a5f in Status: IN_PROGRESS for 2s [ 977.727122] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d82bad56-9830-4c7d-9763-6d8a05e0998c in Status: SUCCESS [ 977.727442] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d82bad56-9830-4c7d-9763-6d8a05e0998c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.602957] env[65306]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 978.602957] env[65306]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 978.982048] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7c868cfd-e55d-4976-95db-5b3f64c76a5f in Status: SUCCESS [ 978.982351] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7c868cfd-e55d-4976-95db-5b3f64c76a5f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.982552] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7c868cfd-e55d-4976-95db-5b3f64c76a5f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.982787] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7c868cfd-e55d-4976-95db-5b3f64c76a5f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.983099] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.983319] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.983453] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.983700] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.983886] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.983998] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7c868cfd-e55d-4976-95db-5b3f64c76a5f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.984178] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7c868cfd-e55d-4976-95db-5b3f64c76a5f',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 979.486526] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-7c868cfd-e55d-4976-95db-5b3f64c76a5f taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.486699] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7c868cfd-e55d-4976-95db-5b3f64c76a5f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.486771] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7c868cfd-e55d-4976-95db-5b3f64c76a5f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.487068] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7c868cfd-e55d-4976-95db-5b3f64c76a5f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.487276] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.487388] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.487492] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.487611] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.487700] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.487785] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7c868cfd-e55d-4976-95db-5b3f64c76a5f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.487933] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-7c868cfd-e55d-4976-95db-5b3f64c76a5f taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.488067] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7c868cfd-e55d-4976-95db-5b3f64c76a5f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.488135] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7c868cfd-e55d-4976-95db-5b3f64c76a5f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.488283] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7c868cfd-e55d-4976-95db-5b3f64c76a5f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.488444] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.488545] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.488608] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.488800] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.488878] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.488960] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7c868cfd-e55d-4976-95db-5b3f64c76a5f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.489068] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7c868cfd-e55d-4976-95db-5b3f64c76a5f',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 979.991498] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7c868cfd-e55d-4976-95db-5b3f64c76a5f: rpc.has_security_group_logging(os_id): False [ 980.027640] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.027821] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.027880] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.028129] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.028216] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.028447] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.028548] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.028607] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.028836] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.029035] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.029394] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.029528] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.029621] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.030637] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.030637] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.030637] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.030637] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.030637] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.030637] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.030637] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.030637] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7c868cfd-e55d-4976-95db-5b3f64c76a5f is going to be updated. [ 980.152959] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.153164] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.153262] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.153567] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.153773] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.170974] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7c868cfd-e55d-4976-95db-5b3f64c76a5f in Status: IN_PROGRESS for 2s [ 981.523749] env[65306]: INFO networking_nsxv3.common.synchronization [req-6d837374-38e0-4029-88e8-896d3041fe27 req-57324030-8c6b-4c2d-b832-91d90c5a0590 tempest-ListServerFiltersTestJSON-702113484 tempest-ListServerFiltersTestJSON-702113484-project-member] Enqueued Resource ID: a3364d7c-b2fd-4f01-932a-1feef0fa76de with Priority: HIGHEST for action security_group_members [ 981.524343] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a3364d7c-b2fd-4f01-932a-1feef0fa76de with Priority: HIGHEST for action security_group_members [ 981.525384] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-a3364d7c-b2fd-4f01-932a-1feef0fa76de taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.525384] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a3364d7c-b2fd-4f01-932a-1feef0fa76de" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.525384] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a3364d7c-b2fd-4f01-932a-1feef0fa76de" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.525384] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a3364d7c-b2fd-4f01-932a-1feef0fa76de" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.525384] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.525662] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.525662] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.525752] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.525846] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.525885] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a3364d7c-b2fd-4f01-932a-1feef0fa76de',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 982.028734] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a3364d7c-b2fd-4f01-932a-1feef0fa76de',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 982.190205] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7c868cfd-e55d-4976-95db-5b3f64c76a5f in Status: SUCCESS [ 982.190894] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7c868cfd-e55d-4976-95db-5b3f64c76a5f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.531161] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a3364d7c-b2fd-4f01-932a-1feef0fa76de',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 983.033996] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.034181] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.034257] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.034509] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.034752] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.034888] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a3364d7c-b2fd-4f01-932a-1feef0fa76de is going to be updated. [ 983.085273] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.085505] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.085505] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.085695] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.085845] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.096619] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a3364d7c-b2fd-4f01-932a-1feef0fa76de in Status: IN_PROGRESS for 2s [ 984.388858] env[65306]: INFO networking_nsxv3.common.synchronization [req-3400925a-f4f4-4937-8dbe-e765c7648c86 req-fae6c035-e2c3-4e6b-8b96-2cc3bcab7414 tempest-DeleteServersTestJSON-1340326246 tempest-DeleteServersTestJSON-1340326246-project-member] Enqueued Resource ID: d82bad56-9830-4c7d-9763-6d8a05e0998c with Priority: HIGHEST for action security_group_members [ 984.389549] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d82bad56-9830-4c7d-9763-6d8a05e0998c with Priority: HIGHEST for action security_group_members [ 984.389876] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-d82bad56-9830-4c7d-9763-6d8a05e0998c taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.390028] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d82bad56-9830-4c7d-9763-6d8a05e0998c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.390099] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d82bad56-9830-4c7d-9763-6d8a05e0998c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.390432] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d82bad56-9830-4c7d-9763-6d8a05e0998c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.390831] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.390831] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.390831] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.390997] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.391066] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.391159] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d82bad56-9830-4c7d-9763-6d8a05e0998c',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 984.562314] env[65306]: INFO networking_nsxv3.common.synchronization [req-56dcfe07-2da1-4ad7-b187-938cea96a4a1 req-f8c1b56d-b612-4bfd-906a-205c8e8e6611 tempest-ServerTagsTestJSON-1426340120 tempest-ServerTagsTestJSON-1426340120-project-member] Enqueued Resource ID: d7a326c8-f35c-48c1-831b-ebd2cbb656e7 with Priority: HIGHEST for action security_group_members [ 984.562314] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d7a326c8-f35c-48c1-831b-ebd2cbb656e7 with Priority: HIGHEST for action security_group_members [ 984.562314] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-d7a326c8-f35c-48c1-831b-ebd2cbb656e7 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.562314] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d7a326c8-f35c-48c1-831b-ebd2cbb656e7" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.562314] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d7a326c8-f35c-48c1-831b-ebd2cbb656e7" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.562314] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d7a326c8-f35c-48c1-831b-ebd2cbb656e7" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.562314] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.562314] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.562314] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.562314] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.562314] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.562314] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d7a326c8-f35c-48c1-831b-ebd2cbb656e7',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 984.893696] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.893802] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.893885] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.894130] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.894421] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.894421] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.894676] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.894676] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.894770] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.894811] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.894922] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d82bad56-9830-4c7d-9763-6d8a05e0998c is going to be updated. [ 984.929301] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.929301] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.929301] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.929301] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.929301] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.940683] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d82bad56-9830-4c7d-9763-6d8a05e0998c in Status: IN_PROGRESS for 2s [ 984.944735] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock network-850 taken with stack trace [, , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.944968] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "network-850" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.945082] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "network-850" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.945427] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "network-850" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.945694] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.945873] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.946309] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.946407] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.946652] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.947245] env[65306]: DEBUG dogpile.cache.region [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] No value present for key: 'zone-id' {{(pid=65306) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 984.947245] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] NeedRegenerationException {{(pid=65306) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 984.947368] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] no value, waiting for create lock {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 984.947543] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] value creation lock acquired {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 984.947668] env[65306]: DEBUG dogpile.cache.region [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] No value present for key: 'zone-id' {{(pid=65306) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 984.947861] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Calling creation function for not-yet-present value {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 984.948272] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 984.984026] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 984.984026] env[65306]: DEBUG dogpile.cache.region [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Cache value generated in 0.035 seconds for key(s): 'zone-id' {{(pid=65306) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 984.984026] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Released creation lock {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 984.984026] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "network-850" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.984026] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock port-f7323400-1966-40f8-82c9-197d91136065 taken with stack trace [, , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.984026] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "port-f7323400-1966-40f8-82c9-197d91136065" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.984816] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "port-f7323400-1966-40f8-82c9-197d91136065" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.985426] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "port-f7323400-1966-40f8-82c9-197d91136065" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.985783] env[65306]: DEBUG networking_nsxv3.api.rpc [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f7323400-1966-40f8-82c9-197d91136065',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 985.065851] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.066066] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.066186] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.066422] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.066586] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.066843] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.066988] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.067043] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.067225] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.067331] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.067446] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d7a326c8-f35c-48c1-831b-ebd2cbb656e7 already deleted. [ 985.067561] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d7a326c8-f35c-48c1-831b-ebd2cbb656e7" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.110692] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a3364d7c-b2fd-4f01-932a-1feef0fa76de in Status: SUCCESS [ 985.110998] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a3364d7c-b2fd-4f01-932a-1feef0fa76de" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.488769] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.489139] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.489182] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.490033] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.490033] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.490033] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Segment Port f7323400-1966-40f8-82c9-197d91136065 not found, creating... [ 985.490282] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.490438] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.490525] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.491174] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.491174] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.491174] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.492028] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.492028] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.492028] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.492028] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.492399] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Resource: SegmentPort with ID: f7323400-1966-40f8-82c9-197d91136065 is going to be created. [ 985.514293] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.514557] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.515394] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.515394] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.515394] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.515654] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "port-f7323400-1966-40f8-82c9-197d91136065" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.922375] env[65306]: INFO networking_nsxv3.common.synchronization [req-7ac13195-6719-464e-b06b-a95c8a3fdcac req-c3a4f1b4-a357-425a-a1db-c3fa497bbeaf tempest-ServersNegativeTestJSON-1568308048 tempest-ServersNegativeTestJSON-1568308048-project-member] Enqueued Resource ID: 7c868cfd-e55d-4976-95db-5b3f64c76a5f with Priority: HIGHEST for action security_group_members [ 985.922375] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7c868cfd-e55d-4976-95db-5b3f64c76a5f with Priority: HIGHEST for action security_group_members [ 985.922767] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-7c868cfd-e55d-4976-95db-5b3f64c76a5f taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.923070] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7c868cfd-e55d-4976-95db-5b3f64c76a5f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.923235] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7c868cfd-e55d-4976-95db-5b3f64c76a5f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.923508] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7c868cfd-e55d-4976-95db-5b3f64c76a5f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.923787] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.923997] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.924165] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.924407] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.924581] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.924757] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7c868cfd-e55d-4976-95db-5b3f64c76a5f',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 986.366112] env[65306]: INFO networking_nsxv3.common.synchronization [req-56dcfe07-2da1-4ad7-b187-938cea96a4a1 req-7dcb5b7b-1f19-4663-9a44-387fbae7e490 service nova] Enqueued Resource ID: d7a326c8-f35c-48c1-831b-ebd2cbb656e7 with Priority: HIGHEST for action security_group_rules [ 986.366329] env[65306]: INFO networking_nsxv3.common.synchronization [req-56dcfe07-2da1-4ad7-b187-938cea96a4a1 req-7dcb5b7b-1f19-4663-9a44-387fbae7e490 service nova] Enqueued Resource ID: d7a326c8-f35c-48c1-831b-ebd2cbb656e7 with Priority: HIGHEST for action security_group_members [ 986.366516] env[65306]: INFO networking_nsxv3.common.synchronization [req-56dcfe07-2da1-4ad7-b187-938cea96a4a1 req-7dcb5b7b-1f19-4663-9a44-387fbae7e490 service nova] Enqueued Resource ID: f7323400-1966-40f8-82c9-197d91136065 with Priority: HIGHEST for action port [ 986.367143] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d7a326c8-f35c-48c1-831b-ebd2cbb656e7 with Priority: HIGHEST for action security_group_rules [ 986.367316] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d7a326c8-f35c-48c1-831b-ebd2cbb656e7 with Priority: HIGHEST for action security_group_members [ 986.367449] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f7323400-1966-40f8-82c9-197d91136065 with Priority: HIGHEST for action port [ 986.368054] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d7a326c8-f35c-48c1-831b-ebd2cbb656e7 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.368054] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d7a326c8-f35c-48c1-831b-ebd2cbb656e7" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.368187] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d7a326c8-f35c-48c1-831b-ebd2cbb656e7" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.368409] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d7a326c8-f35c-48c1-831b-ebd2cbb656e7" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.368499] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d7a326c8-f35c-48c1-831b-ebd2cbb656e7',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 986.369383] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-d7a326c8-f35c-48c1-831b-ebd2cbb656e7 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.369535] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d7a326c8-f35c-48c1-831b-ebd2cbb656e7" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.369623] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d7a326c8-f35c-48c1-831b-ebd2cbb656e7" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.369820] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d7a326c8-f35c-48c1-831b-ebd2cbb656e7" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.369972] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.370083] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.370142] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.370282] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.370366] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.370456] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d7a326c8-f35c-48c1-831b-ebd2cbb656e7',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 986.371607] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock port-f7323400-1966-40f8-82c9-197d91136065 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.371719] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f7323400-1966-40f8-82c9-197d91136065" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.371789] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f7323400-1966-40f8-82c9-197d91136065" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.371930] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f7323400-1966-40f8-82c9-197d91136065" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.372048] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f7323400-1966-40f8-82c9-197d91136065',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 986.427353] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7c868cfd-e55d-4976-95db-5b3f64c76a5f',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 986.873632] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-d7a326c8-f35c-48c1-831b-ebd2cbb656e7 taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.874120] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d7a326c8-f35c-48c1-831b-ebd2cbb656e7" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.874120] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d7a326c8-f35c-48c1-831b-ebd2cbb656e7',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 986.874878] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f7323400-1966-40f8-82c9-197d91136065 with status ACTIVE [ 986.875138] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.875258] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.875328] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.875527] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.875616] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.875787] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.875882] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.875944] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.876585] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.876585] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.876585] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.876585] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.876585] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.876841] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.876841] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.876841] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f7323400-1966-40f8-82c9-197d91136065 is going to be updated. [ 986.899276] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.899516] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.899516] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.899819] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.899907] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.900058] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f7323400-1966-40f8-82c9-197d91136065" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.929526] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7c868cfd-e55d-4976-95db-5b3f64c76a5f',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 986.970464] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d82bad56-9830-4c7d-9763-6d8a05e0998c in Status: SUCCESS [ 986.970752] env[65306]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d82bad56-9830-4c7d-9763-6d8a05e0998c deletion is rescheduled due to dependency. [ 986.970942] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d82bad56-9830-4c7d-9763-6d8a05e0998c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.379021] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d7a326c8-f35c-48c1-831b-ebd2cbb656e7',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 987.432027] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.432154] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.432154] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.432563] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.432741] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.432806] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7c868cfd-e55d-4976-95db-5b3f64c76a5f is going to be updated. [ 987.466777] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.466959] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.467056] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.467304] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.467484] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.477796] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7c868cfd-e55d-4976-95db-5b3f64c76a5f in Status: IN_PROGRESS for 2s [ 987.882082] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.882725] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.882953] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.883441] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.883668] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.883924] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d7a326c8-f35c-48c1-831b-ebd2cbb656e7 is going to be created. [ 987.928806] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.928884] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.928930] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.929187] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.929438] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.940970] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d7a326c8-f35c-48c1-831b-ebd2cbb656e7 in Status: UNINITIALIZED for 2s [ 989.221860] env[65306]: INFO networking_nsxv3.common.synchronization [req-63459a18-0a88-4db8-b444-7e617ba2fc5d req-5b7e41f5-0c73-4233-99c2-9c30b500997f tempest-AttachVolumeShelveTestJSON-1351401733 tempest-AttachVolumeShelveTestJSON-1351401733-project-member] Enqueued Resource ID: 4ccf00ad-53bf-45d0-a342-260b14c2ccf2 with Priority: HIGHEST for action security_group_members [ 989.223213] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4ccf00ad-53bf-45d0-a342-260b14c2ccf2 with Priority: HIGHEST for action security_group_members [ 989.223434] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-4ccf00ad-53bf-45d0-a342-260b14c2ccf2 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.223585] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4ccf00ad-53bf-45d0-a342-260b14c2ccf2" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.223654] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4ccf00ad-53bf-45d0-a342-260b14c2ccf2" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.223928] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4ccf00ad-53bf-45d0-a342-260b14c2ccf2" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.224106] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.224213] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.224445] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.224445] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.224518] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.224629] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4ccf00ad-53bf-45d0-a342-260b14c2ccf2',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 989.490134] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7c868cfd-e55d-4976-95db-5b3f64c76a5f in Status: SUCCESS [ 989.490518] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7c868cfd-e55d-4976-95db-5b3f64c76a5f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.655683] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock network-270 taken with stack trace [, , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.656269] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "network-270" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.656883] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "network-270" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.656883] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "network-270" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.657092] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.657258] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.657375] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.657602] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.657752] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.657960] env[65306]: DEBUG dogpile.cache.region [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] No value present for key: 'zone-id' {{(pid=65306) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 989.658085] env[65306]: DEBUG dogpile.lock [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] NeedRegenerationException {{(pid=65306) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 989.658197] env[65306]: DEBUG dogpile.lock [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] no value, waiting for create lock {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 989.658306] env[65306]: DEBUG dogpile.lock [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] value creation lock acquired {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 989.658427] env[65306]: DEBUG dogpile.cache.region [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] No value present for key: 'zone-id' {{(pid=65306) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 989.658545] env[65306]: DEBUG dogpile.lock [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Calling creation function for not-yet-present value {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 989.658696] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 989.682994] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 989.683197] env[65306]: DEBUG dogpile.cache.region [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65306) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 989.683341] env[65306]: DEBUG dogpile.lock [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Released creation lock {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 989.683518] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "network-270" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.683829] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock port-2483e5d8-61cb-4cc0-9b9a-953ed7af1309 taken with stack trace [, , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.684007] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "port-2483e5d8-61cb-4cc0-9b9a-953ed7af1309" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.684145] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "port-2483e5d8-61cb-4cc0-9b9a-953ed7af1309" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.684548] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "port-2483e5d8-61cb-4cc0-9b9a-953ed7af1309" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.684698] env[65306]: DEBUG networking_nsxv3.api.rpc [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2483e5d8-61cb-4cc0-9b9a-953ed7af1309',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 989.726746] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.727082] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.727217] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.727452] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.727560] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.727903] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.728037] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.728101] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.728225] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.728308] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.728402] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4ccf00ad-53bf-45d0-a342-260b14c2ccf2 already deleted. [ 989.728496] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4ccf00ad-53bf-45d0-a342-260b14c2ccf2" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.952193] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d7a326c8-f35c-48c1-831b-ebd2cbb656e7 in Status: SUCCESS [ 989.952416] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d7a326c8-f35c-48c1-831b-ebd2cbb656e7" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.952618] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d7a326c8-f35c-48c1-831b-ebd2cbb656e7" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.952818] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d7a326c8-f35c-48c1-831b-ebd2cbb656e7" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.953140] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.953140] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.953242] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.953338] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.953419] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.953504] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d7a326c8-f35c-48c1-831b-ebd2cbb656e7" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.953596] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d7a326c8-f35c-48c1-831b-ebd2cbb656e7',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 990.190914] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.190914] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.190914] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.190914] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.191228] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.191228] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Segment Port 2483e5d8-61cb-4cc0-9b9a-953ed7af1309 not found, creating... [ 990.191543] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.191708] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.191829] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.192091] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.192251] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.192616] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.192879] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.193589] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.193589] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.193589] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.193589] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Resource: SegmentPort with ID: 2483e5d8-61cb-4cc0-9b9a-953ed7af1309 is going to be created. [ 990.221178] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.221178] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.221178] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.221178] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.221178] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.221178] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "port-2483e5d8-61cb-4cc0-9b9a-953ed7af1309" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.456484] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-d7a326c8-f35c-48c1-831b-ebd2cbb656e7 taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.456484] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d7a326c8-f35c-48c1-831b-ebd2cbb656e7" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.460024] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d7a326c8-f35c-48c1-831b-ebd2cbb656e7" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.460024] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d7a326c8-f35c-48c1-831b-ebd2cbb656e7" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.460024] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.460024] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.460024] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.460024] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.460024] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.460024] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d7a326c8-f35c-48c1-831b-ebd2cbb656e7" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.460024] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-d7a326c8-f35c-48c1-831b-ebd2cbb656e7 taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.460024] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d7a326c8-f35c-48c1-831b-ebd2cbb656e7" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.460024] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d7a326c8-f35c-48c1-831b-ebd2cbb656e7" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.460024] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d7a326c8-f35c-48c1-831b-ebd2cbb656e7" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.460024] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.460024] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.460024] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.460024] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.460024] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.460024] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d7a326c8-f35c-48c1-831b-ebd2cbb656e7" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.460696] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d7a326c8-f35c-48c1-831b-ebd2cbb656e7',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 990.963150] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d7a326c8-f35c-48c1-831b-ebd2cbb656e7: rpc.has_security_group_logging(os_id): False [ 990.967016] env[65306]: INFO networking_nsxv3.common.synchronization [req-63459a18-0a88-4db8-b444-7e617ba2fc5d req-2f58301f-8354-4b62-af0c-ec89f626a276 service nova] Enqueued Resource ID: 4ccf00ad-53bf-45d0-a342-260b14c2ccf2 with Priority: HIGHEST for action security_group_rules [ 990.967290] env[65306]: INFO networking_nsxv3.common.synchronization [req-63459a18-0a88-4db8-b444-7e617ba2fc5d req-2f58301f-8354-4b62-af0c-ec89f626a276 service nova] Enqueued Resource ID: 4ccf00ad-53bf-45d0-a342-260b14c2ccf2 with Priority: HIGHEST for action security_group_members [ 990.967452] env[65306]: INFO networking_nsxv3.common.synchronization [req-63459a18-0a88-4db8-b444-7e617ba2fc5d req-2f58301f-8354-4b62-af0c-ec89f626a276 service nova] Enqueued Resource ID: 2483e5d8-61cb-4cc0-9b9a-953ed7af1309 with Priority: HIGHEST for action port [ 990.968595] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4ccf00ad-53bf-45d0-a342-260b14c2ccf2 with Priority: HIGHEST for action security_group_rules [ 990.968759] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4ccf00ad-53bf-45d0-a342-260b14c2ccf2 with Priority: HIGHEST for action security_group_members [ 990.968874] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2483e5d8-61cb-4cc0-9b9a-953ed7af1309 with Priority: HIGHEST for action port [ 990.969213] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4ccf00ad-53bf-45d0-a342-260b14c2ccf2 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.969355] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4ccf00ad-53bf-45d0-a342-260b14c2ccf2" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.969425] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4ccf00ad-53bf-45d0-a342-260b14c2ccf2" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.969660] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4ccf00ad-53bf-45d0-a342-260b14c2ccf2" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.969758] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4ccf00ad-53bf-45d0-a342-260b14c2ccf2',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 990.972046] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-4ccf00ad-53bf-45d0-a342-260b14c2ccf2 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.972207] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4ccf00ad-53bf-45d0-a342-260b14c2ccf2" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.972282] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4ccf00ad-53bf-45d0-a342-260b14c2ccf2" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.972527] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4ccf00ad-53bf-45d0-a342-260b14c2ccf2" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.972691] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.972827] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.972892] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.973111] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.973251] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.973375] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4ccf00ad-53bf-45d0-a342-260b14c2ccf2',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 990.974799] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock port-2483e5d8-61cb-4cc0-9b9a-953ed7af1309 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.975170] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2483e5d8-61cb-4cc0-9b9a-953ed7af1309" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.975170] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2483e5d8-61cb-4cc0-9b9a-953ed7af1309" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.975256] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2483e5d8-61cb-4cc0-9b9a-953ed7af1309" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.975293] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2483e5d8-61cb-4cc0-9b9a-953ed7af1309',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 990.989231] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.989511] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.989624] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.989931] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.990076] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.990419] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.990590] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.990655] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.990878] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.990986] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.991235] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.991368] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.991481] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.991733] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.991811] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.992040] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.992141] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.992203] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.992364] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.992436] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.992532] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d7a326c8-f35c-48c1-831b-ebd2cbb656e7 is going to be created. [ 991.070420] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.070630] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.070630] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.070783] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.070968] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.084314] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d7a326c8-f35c-48c1-831b-ebd2cbb656e7 in Status: IN_PROGRESS for 2s [ 991.477459] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4ccf00ad-53bf-45d0-a342-260b14c2ccf2',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 991.479041] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-4ccf00ad-53bf-45d0-a342-260b14c2ccf2 taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.479041] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4ccf00ad-53bf-45d0-a342-260b14c2ccf2" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.479041] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2483e5d8-61cb-4cc0-9b9a-953ed7af1309 with status ACTIVE [ 991.479041] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.479328] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.479328] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.479681] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.479681] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.479778] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.479868] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.479943] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.480118] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.480197] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.480379] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.480472] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.480537] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.480682] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.480758] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.481212] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2483e5d8-61cb-4cc0-9b9a-953ed7af1309 is going to be updated. [ 991.503994] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.504181] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.504270] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.504463] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.504608] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.504778] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2483e5d8-61cb-4cc0-9b9a-953ed7af1309" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.983788] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4ccf00ad-53bf-45d0-a342-260b14c2ccf2',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 992.486696] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.487095] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.487095] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.487274] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.487336] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.487430] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4ccf00ad-53bf-45d0-a342-260b14c2ccf2 is going to be created. [ 992.506032] env[65306]: INFO networking_nsxv3.common.synchronization [req-db0765d9-f0f2-43d4-a55e-d21df9eeec6f req-1fb62729-e138-4b4d-88dd-3272ede65d8d tempest-TenantUsagesTestJSON-2047512986 tempest-TenantUsagesTestJSON-2047512986-project-member] Enqueued Resource ID: 7b301620-e19b-4a95-9103-ce7982b7fa1d with Priority: HIGHEST for action security_group_members [ 992.506641] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7b301620-e19b-4a95-9103-ce7982b7fa1d with Priority: HIGHEST for action security_group_members [ 992.507783] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-7b301620-e19b-4a95-9103-ce7982b7fa1d taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.507942] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7b301620-e19b-4a95-9103-ce7982b7fa1d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.507991] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7b301620-e19b-4a95-9103-ce7982b7fa1d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.508264] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7b301620-e19b-4a95-9103-ce7982b7fa1d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.508436] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.508545] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.508609] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.508779] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.508862] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.508959] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7b301620-e19b-4a95-9103-ce7982b7fa1d',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 992.520778] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.520917] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.520985] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.521210] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.521384] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.535322] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4ccf00ad-53bf-45d0-a342-260b14c2ccf2 in Status: UNINITIALIZED for 2s [ 992.844419] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock network-707 taken with stack trace [, , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.844608] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "network-707" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.844739] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "network-707" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.845015] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "network-707" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.845279] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.845434] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.845548] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.845762] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.845903] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.846312] env[65306]: DEBUG dogpile.cache.region [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] No value present for key: 'zone-id' {{(pid=65306) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 992.846435] env[65306]: DEBUG dogpile.lock [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] NeedRegenerationException {{(pid=65306) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 992.846549] env[65306]: DEBUG dogpile.lock [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] no value, waiting for create lock {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 992.846658] env[65306]: DEBUG dogpile.lock [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] value creation lock acquired {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 992.846771] env[65306]: DEBUG dogpile.cache.region [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] No value present for key: 'zone-id' {{(pid=65306) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 992.846921] env[65306]: DEBUG dogpile.lock [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Calling creation function for not-yet-present value {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 992.848601] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 992.865704] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 992.865874] env[65306]: DEBUG dogpile.cache.region [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=65306) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 992.866033] env[65306]: DEBUG dogpile.lock [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Released creation lock {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 992.866215] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "network-707" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.866535] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock port-8fbd7ac9-4b8d-43b4-a14d-83ac0c74fc9f taken with stack trace [, , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.866703] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "port-8fbd7ac9-4b8d-43b4-a14d-83ac0c74fc9f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.866820] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "port-8fbd7ac9-4b8d-43b4-a14d-83ac0c74fc9f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.867153] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "port-8fbd7ac9-4b8d-43b4-a14d-83ac0c74fc9f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.867289] env[65306]: DEBUG networking_nsxv3.api.rpc [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8fbd7ac9-4b8d-43b4-a14d-83ac0c74fc9f',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 993.012442] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.012647] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.012726] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.012945] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.013053] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.013251] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.013351] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.013413] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.013563] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.013639] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.013731] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7b301620-e19b-4a95-9103-ce7982b7fa1d already deleted. [ 993.013914] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7b301620-e19b-4a95-9103-ce7982b7fa1d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.101618] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d7a326c8-f35c-48c1-831b-ebd2cbb656e7 in Status: SUCCESS [ 993.101869] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d7a326c8-f35c-48c1-831b-ebd2cbb656e7" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.371040] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.371040] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.371040] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.371371] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.371371] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.371371] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Segment Port 8fbd7ac9-4b8d-43b4-a14d-83ac0c74fc9f not found, creating... [ 993.371808] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.372048] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.372157] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.372481] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.372771] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.372965] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.373219] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.373408] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.373710] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.373949] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.374148] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Resource: SegmentPort with ID: 8fbd7ac9-4b8d-43b4-a14d-83ac0c74fc9f is going to be created. [ 993.405122] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.405521] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.405742] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.406127] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.406486] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.406799] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "port-8fbd7ac9-4b8d-43b4-a14d-83ac0c74fc9f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.100559] env[65306]: INFO networking_nsxv3.common.synchronization [req-db0765d9-f0f2-43d4-a55e-d21df9eeec6f req-908ca5c2-9ff8-46ad-bf72-2981b6c2fb4f service nova] Enqueued Resource ID: 7b301620-e19b-4a95-9103-ce7982b7fa1d with Priority: HIGHEST for action security_group_rules [ 994.100881] env[65306]: INFO networking_nsxv3.common.synchronization [req-db0765d9-f0f2-43d4-a55e-d21df9eeec6f req-908ca5c2-9ff8-46ad-bf72-2981b6c2fb4f service nova] Enqueued Resource ID: 7b301620-e19b-4a95-9103-ce7982b7fa1d with Priority: HIGHEST for action security_group_members [ 994.100881] env[65306]: INFO networking_nsxv3.common.synchronization [req-db0765d9-f0f2-43d4-a55e-d21df9eeec6f req-908ca5c2-9ff8-46ad-bf72-2981b6c2fb4f service nova] Enqueued Resource ID: 8fbd7ac9-4b8d-43b4-a14d-83ac0c74fc9f with Priority: HIGHEST for action port [ 994.101438] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7b301620-e19b-4a95-9103-ce7982b7fa1d with Priority: HIGHEST for action security_group_rules [ 994.101816] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7b301620-e19b-4a95-9103-ce7982b7fa1d with Priority: HIGHEST for action security_group_members [ 994.101816] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8fbd7ac9-4b8d-43b4-a14d-83ac0c74fc9f with Priority: HIGHEST for action port [ 994.102042] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7b301620-e19b-4a95-9103-ce7982b7fa1d taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.102185] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7b301620-e19b-4a95-9103-ce7982b7fa1d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.102327] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7b301620-e19b-4a95-9103-ce7982b7fa1d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.102500] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7b301620-e19b-4a95-9103-ce7982b7fa1d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.102586] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7b301620-e19b-4a95-9103-ce7982b7fa1d',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 994.103480] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-7b301620-e19b-4a95-9103-ce7982b7fa1d taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.103600] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7b301620-e19b-4a95-9103-ce7982b7fa1d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.103680] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7b301620-e19b-4a95-9103-ce7982b7fa1d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.103873] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7b301620-e19b-4a95-9103-ce7982b7fa1d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.103992] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.104096] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.104158] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.104299] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.104380] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.104469] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7b301620-e19b-4a95-9103-ce7982b7fa1d',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 994.105256] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock port-8fbd7ac9-4b8d-43b4-a14d-83ac0c74fc9f taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.105364] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8fbd7ac9-4b8d-43b4-a14d-83ac0c74fc9f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.105431] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8fbd7ac9-4b8d-43b4-a14d-83ac0c74fc9f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.105587] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8fbd7ac9-4b8d-43b4-a14d-83ac0c74fc9f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.105661] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8fbd7ac9-4b8d-43b4-a14d-83ac0c74fc9f',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 994.546852] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4ccf00ad-53bf-45d0-a342-260b14c2ccf2 in Status: SUCCESS [ 994.547090] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4ccf00ad-53bf-45d0-a342-260b14c2ccf2" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.547270] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4ccf00ad-53bf-45d0-a342-260b14c2ccf2" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.547525] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4ccf00ad-53bf-45d0-a342-260b14c2ccf2" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.547707] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.547931] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.547931] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.548093] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.548093] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.548159] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4ccf00ad-53bf-45d0-a342-260b14c2ccf2" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.548240] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4ccf00ad-53bf-45d0-a342-260b14c2ccf2',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 994.608056] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7b301620-e19b-4a95-9103-ce7982b7fa1d',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 994.609056] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-7b301620-e19b-4a95-9103-ce7982b7fa1d taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.609183] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7b301620-e19b-4a95-9103-ce7982b7fa1d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.611970] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8fbd7ac9-4b8d-43b4-a14d-83ac0c74fc9f with status ACTIVE [ 994.611970] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.613041] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.613041] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.613041] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.613041] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.613041] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.613041] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.613041] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.613041] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.613041] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.613931] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.613931] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.613931] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.613931] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.614113] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.614113] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8fbd7ac9-4b8d-43b4-a14d-83ac0c74fc9f is going to be updated. [ 994.648050] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.648050] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.648285] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.648421] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.648567] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.648741] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8fbd7ac9-4b8d-43b4-a14d-83ac0c74fc9f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.050801] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4ccf00ad-53bf-45d0-a342-260b14c2ccf2',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 995.112400] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7b301620-e19b-4a95-9103-ce7982b7fa1d',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 995.553868] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4ccf00ad-53bf-45d0-a342-260b14c2ccf2: rpc.has_security_group_logging(os_id): False [ 995.584043] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.584043] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.584043] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.584043] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.584043] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.584351] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.584351] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.584351] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.584351] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.584502] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.584502] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4ccf00ad-53bf-45d0-a342-260b14c2ccf2 is going to be created. [ 995.616516] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.616516] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.616516] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.616771] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.616807] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.616915] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7b301620-e19b-4a95-9103-ce7982b7fa1d is going to be created. [ 995.657808] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.657999] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.658100] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.658383] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.658685] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.664068] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.664340] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.664620] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.664846] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.666579] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.674500] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7b301620-e19b-4a95-9103-ce7982b7fa1d in Status: UNINITIALIZED for 2s [ 995.678979] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4ccf00ad-53bf-45d0-a342-260b14c2ccf2 in Status: IN_PROGRESS for 2s [ 996.521836] env[65306]: INFO networking_nsxv3.common.synchronization [req-c47da1f0-7657-4e6c-8713-21e94fdf8cbb req-681666a7-422f-4106-85bc-52ddb1ff8486 tempest-ServerActionsTestJSON-437813836 tempest-ServerActionsTestJSON-437813836-project-member] Enqueued Resource ID: 3bb1834c-39ac-4ba9-bce1-44f7a4805a24 with Priority: HIGHEST for action security_group_members [ 996.522489] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3bb1834c-39ac-4ba9-bce1-44f7a4805a24 with Priority: HIGHEST for action security_group_members [ 996.522831] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-3bb1834c-39ac-4ba9-bce1-44f7a4805a24 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.522949] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3bb1834c-39ac-4ba9-bce1-44f7a4805a24" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.523063] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3bb1834c-39ac-4ba9-bce1-44f7a4805a24" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.523243] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3bb1834c-39ac-4ba9-bce1-44f7a4805a24" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.523465] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.523596] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.523596] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.523697] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.523796] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.523867] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3bb1834c-39ac-4ba9-bce1-44f7a4805a24',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 997.025756] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.026114] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.026227] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.026471] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.026558] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.026770] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.026893] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.026986] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.027122] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.027205] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.027298] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3bb1834c-39ac-4ba9-bce1-44f7a4805a24 is going to be updated. [ 997.058251] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.058540] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.058540] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.058660] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.058811] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.069102] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3bb1834c-39ac-4ba9-bce1-44f7a4805a24 in Status: IN_PROGRESS for 2s [ 997.294707] env[65306]: INFO networking_nsxv3.common.synchronization [req-443459dd-675c-4840-ac2d-9332cbfe47aa req-f7cda28a-5125-4dea-aa5c-961dd753f6b1 tempest-ImagesTestJSON-762064805 tempest-ImagesTestJSON-762064805-project-member] Enqueued Resource ID: 57bb6fe9-98c4-47f0-9daa-c424a0c9dfee with Priority: HIGHEST for action security_group_members [ 997.295339] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 57bb6fe9-98c4-47f0-9daa-c424a0c9dfee with Priority: HIGHEST for action security_group_members [ 997.295693] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-57bb6fe9-98c4-47f0-9daa-c424a0c9dfee taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.295980] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-57bb6fe9-98c4-47f0-9daa-c424a0c9dfee" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.297326] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-57bb6fe9-98c4-47f0-9daa-c424a0c9dfee" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.297592] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-57bb6fe9-98c4-47f0-9daa-c424a0c9dfee" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.297776] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.297885] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.297948] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.298147] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.298810] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.299509] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('57bb6fe9-98c4-47f0-9daa-c424a0c9dfee',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 997.687393] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7b301620-e19b-4a95-9103-ce7982b7fa1d in Status: SUCCESS [ 997.687680] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7b301620-e19b-4a95-9103-ce7982b7fa1d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.687772] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7b301620-e19b-4a95-9103-ce7982b7fa1d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.687987] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7b301620-e19b-4a95-9103-ce7982b7fa1d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.688197] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.688312] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.688368] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.688520] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.688600] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.688684] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7b301620-e19b-4a95-9103-ce7982b7fa1d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.688772] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7b301620-e19b-4a95-9103-ce7982b7fa1d',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 997.691999] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4ccf00ad-53bf-45d0-a342-260b14c2ccf2 in Status: SUCCESS [ 997.691999] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4ccf00ad-53bf-45d0-a342-260b14c2ccf2" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.758833] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock network-873 taken with stack trace [, , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.759330] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "network-873" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.759330] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "network-873" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.759844] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "network-873" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.759844] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.759844] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.760118] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.760166] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.760324] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.760541] env[65306]: DEBUG dogpile.cache.region [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] No value present for key: 'zone-id' {{(pid=65306) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 997.760657] env[65306]: DEBUG dogpile.lock [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] NeedRegenerationException {{(pid=65306) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 997.760769] env[65306]: DEBUG dogpile.lock [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] no value, waiting for create lock {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 997.760877] env[65306]: DEBUG dogpile.lock [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] value creation lock acquired {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 997.760999] env[65306]: DEBUG dogpile.cache.region [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] No value present for key: 'zone-id' {{(pid=65306) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 997.761115] env[65306]: DEBUG dogpile.lock [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Calling creation function for not-yet-present value {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 997.761247] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 997.784056] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 997.784299] env[65306]: DEBUG dogpile.cache.region [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65306) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 997.784471] env[65306]: DEBUG dogpile.lock [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Released creation lock {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 997.784679] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "network-873" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.785087] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock port-88165544-9e62-493b-8731-710444247e5b taken with stack trace [, , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.785315] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "port-88165544-9e62-493b-8731-710444247e5b" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.785535] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "port-88165544-9e62-493b-8731-710444247e5b" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.785880] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "port-88165544-9e62-493b-8731-710444247e5b" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.786079] env[65306]: DEBUG networking_nsxv3.api.rpc [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('88165544-9e62-493b-8731-710444247e5b',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 997.803013] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('57bb6fe9-98c4-47f0-9daa-c424a0c9dfee',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 997.828050] env[65306]: INFO networking_nsxv3.common.synchronization [req-75be195b-3d0e-41b2-9928-521ada85e888 req-93f4b861-771d-4d6c-a1a6-32e8adb77a9e tempest-ServersAdminTestJSON-2076938379 tempest-ServersAdminTestJSON-2076938379-project-member] Enqueued Resource ID: 56904b3c-38e4-4547-9a1d-cc787c3fef9d with Priority: HIGHEST for action security_group_members [ 997.829786] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 56904b3c-38e4-4547-9a1d-cc787c3fef9d with Priority: HIGHEST for action security_group_members [ 997.829786] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-56904b3c-38e4-4547-9a1d-cc787c3fef9d taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.829786] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-56904b3c-38e4-4547-9a1d-cc787c3fef9d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.829786] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-56904b3c-38e4-4547-9a1d-cc787c3fef9d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.829786] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-56904b3c-38e4-4547-9a1d-cc787c3fef9d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.830069] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.830069] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.830210] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.830381] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.830468] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.830564] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('56904b3c-38e4-4547-9a1d-cc787c3fef9d',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 998.191452] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-7b301620-e19b-4a95-9103-ce7982b7fa1d taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.191677] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7b301620-e19b-4a95-9103-ce7982b7fa1d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.191782] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7b301620-e19b-4a95-9103-ce7982b7fa1d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.192107] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7b301620-e19b-4a95-9103-ce7982b7fa1d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.192213] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.192328] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.192621] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.192738] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.192780] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.192853] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7b301620-e19b-4a95-9103-ce7982b7fa1d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.193020] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-7b301620-e19b-4a95-9103-ce7982b7fa1d taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.193120] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7b301620-e19b-4a95-9103-ce7982b7fa1d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.193177] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7b301620-e19b-4a95-9103-ce7982b7fa1d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.193336] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7b301620-e19b-4a95-9103-ce7982b7fa1d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.193479] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.193575] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.193630] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.193776] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.193851] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.193934] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7b301620-e19b-4a95-9103-ce7982b7fa1d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.194030] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7b301620-e19b-4a95-9103-ce7982b7fa1d',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 998.288695] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.289018] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.289066] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.289342] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.289494] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.289682] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Segment Port 88165544-9e62-493b-8731-710444247e5b not found, creating... [ 998.290063] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.290278] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.290278] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.290660] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.290660] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.291066] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.291376] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.291376] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.291987] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.291987] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.291987] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Resource: SegmentPort with ID: 88165544-9e62-493b-8731-710444247e5b is going to be created. [ 998.306030] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('57bb6fe9-98c4-47f0-9daa-c424a0c9dfee',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 998.321350] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.321350] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.321350] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.321350] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.321350] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.321350] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "port-88165544-9e62-493b-8731-710444247e5b" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.333402] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('56904b3c-38e4-4547-9a1d-cc787c3fef9d',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 998.697913] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7b301620-e19b-4a95-9103-ce7982b7fa1d: rpc.has_security_group_logging(os_id): False [ 998.718029] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.718029] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.718029] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.718029] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.718029] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.718029] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.718029] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.718029] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.718029] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.718029] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.718029] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.718029] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.718029] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.718029] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.718029] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.719034] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.719513] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.719840] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.720191] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.722164] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.722164] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7b301620-e19b-4a95-9103-ce7982b7fa1d is going to be created. [ 998.792468] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.792777] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.792855] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.793199] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.793486] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.808537] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.809148] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.809148] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.809340] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.809340] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.809801] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 57bb6fe9-98c4-47f0-9daa-c424a0c9dfee is going to be updated. [ 998.812199] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7b301620-e19b-4a95-9103-ce7982b7fa1d in Status: IN_PROGRESS for 2s [ 998.836866] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('56904b3c-38e4-4547-9a1d-cc787c3fef9d',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 998.839802] env[65306]: INFO networking_nsxv3.common.synchronization [req-89dfe826-3e62-4328-b490-36f198596b7d req-287fa304-3b3f-4d4e-bf1e-9698ed773e86 tempest-ServerTagsTestJSON-1426340120 tempest-ServerTagsTestJSON-1426340120-project-member] Enqueued Resource ID: d7a326c8-f35c-48c1-831b-ebd2cbb656e7 with Priority: HIGHEST for action security_group_members [ 998.841805] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d7a326c8-f35c-48c1-831b-ebd2cbb656e7 with Priority: HIGHEST for action security_group_members [ 998.842344] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-d7a326c8-f35c-48c1-831b-ebd2cbb656e7 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.842553] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d7a326c8-f35c-48c1-831b-ebd2cbb656e7" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.842686] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d7a326c8-f35c-48c1-831b-ebd2cbb656e7" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.842992] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d7a326c8-f35c-48c1-831b-ebd2cbb656e7" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.843391] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.843391] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.843533] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.843694] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.843816] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.843951] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d7a326c8-f35c-48c1-831b-ebd2cbb656e7',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 998.871091] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.871091] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.871091] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.871425] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.871425] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.916335] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 57bb6fe9-98c4-47f0-9daa-c424a0c9dfee in Status: IN_PROGRESS for 2s [ 999.079237] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3bb1834c-39ac-4ba9-bce1-44f7a4805a24 in Status: SUCCESS [ 999.079467] env[65306]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3bb1834c-39ac-4ba9-bce1-44f7a4805a24 deletion is rescheduled due to dependency. [ 999.079562] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3bb1834c-39ac-4ba9-bce1-44f7a4805a24" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.095046] env[65306]: INFO networking_nsxv3.common.synchronization [req-443459dd-675c-4840-ac2d-9332cbfe47aa req-7b61ca0a-6ba7-4798-b323-d5e4abe702cd service nova] Enqueued Resource ID: 57bb6fe9-98c4-47f0-9daa-c424a0c9dfee with Priority: HIGHEST for action security_group_rules [ 999.095235] env[65306]: INFO networking_nsxv3.common.synchronization [req-443459dd-675c-4840-ac2d-9332cbfe47aa req-7b61ca0a-6ba7-4798-b323-d5e4abe702cd service nova] Enqueued Resource ID: 57bb6fe9-98c4-47f0-9daa-c424a0c9dfee with Priority: HIGHEST for action security_group_members [ 999.095373] env[65306]: INFO networking_nsxv3.common.synchronization [req-443459dd-675c-4840-ac2d-9332cbfe47aa req-7b61ca0a-6ba7-4798-b323-d5e4abe702cd service nova] Enqueued Resource ID: 88165544-9e62-493b-8731-710444247e5b with Priority: HIGHEST for action port [ 999.095898] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 57bb6fe9-98c4-47f0-9daa-c424a0c9dfee with Priority: HIGHEST for action security_group_rules [ 999.096447] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 57bb6fe9-98c4-47f0-9daa-c424a0c9dfee with Priority: HIGHEST for action security_group_members [ 999.096667] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 88165544-9e62-493b-8731-710444247e5b with Priority: HIGHEST for action port [ 999.096968] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock rules-57bb6fe9-98c4-47f0-9daa-c424a0c9dfee taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.099978] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-57bb6fe9-98c4-47f0-9daa-c424a0c9dfee" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.100067] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-57bb6fe9-98c4-47f0-9daa-c424a0c9dfee" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.100331] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-57bb6fe9-98c4-47f0-9daa-c424a0c9dfee" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.100691] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('57bb6fe9-98c4-47f0-9daa-c424a0c9dfee',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 999.105814] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-57bb6fe9-98c4-47f0-9daa-c424a0c9dfee taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.105942] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-57bb6fe9-98c4-47f0-9daa-c424a0c9dfee" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.106224] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock port-88165544-9e62-493b-8731-710444247e5b taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.106443] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-88165544-9e62-493b-8731-710444247e5b" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.108386] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-88165544-9e62-493b-8731-710444247e5b" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.108517] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-88165544-9e62-493b-8731-710444247e5b" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.108607] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('88165544-9e62-493b-8731-710444247e5b',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 999.341410] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.341668] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.341740] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.341931] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.342052] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.342136] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 56904b3c-38e4-4547-9a1d-cc787c3fef9d is going to be updated. [ 999.348396] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.349264] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.349436] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.349845] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.349845] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.350034] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.350127] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.350180] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.350303] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.350381] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.350473] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d7a326c8-f35c-48c1-831b-ebd2cbb656e7 is going to be updated. [ 999.392832] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.393027] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.393027] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.393203] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.393631] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.395394] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.395394] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.395394] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.395588] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.395657] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.408544] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 56904b3c-38e4-4547-9a1d-cc787c3fef9d in Status: IN_PROGRESS for 2s [ 999.408610] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d7a326c8-f35c-48c1-831b-ebd2cbb656e7 in Status: IN_PROGRESS for 2s [ 999.610665] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-57bb6fe9-98c4-47f0-9daa-c424a0c9dfee taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.610899] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-57bb6fe9-98c4-47f0-9daa-c424a0c9dfee" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.612285] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 88165544-9e62-493b-8731-710444247e5b with status ACTIVE [ 999.613248] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.613427] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.613491] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.613647] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.613738] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.613924] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.614035] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.614100] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.614290] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.614358] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.614639] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.614769] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.614839] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.614987] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.615136] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.615209] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 88165544-9e62-493b-8731-710444247e5b is going to be updated. [ 999.643598] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.643748] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.643811] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.644127] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.644268] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.644429] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-88165544-9e62-493b-8731-710444247e5b" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.691152] env[65306]: INFO networking_nsxv3.common.synchronization [req-49e74943-3179-4e5c-9fa7-3b1947559f34 req-760af74c-e24a-41b0-9c99-d6fa8090a8cd tempest-ServersTestJSON-1773114292 tempest-ServersTestJSON-1773114292-project-member] Enqueued Resource ID: 0cb41b0f-cdd2-4222-95b4-bafd614b7460 with Priority: HIGHEST for action security_group_members [ 999.691800] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0cb41b0f-cdd2-4222-95b4-bafd614b7460 with Priority: HIGHEST for action security_group_members [ 999.692130] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-0cb41b0f-cdd2-4222-95b4-bafd614b7460 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.692326] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0cb41b0f-cdd2-4222-95b4-bafd614b7460" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.692326] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0cb41b0f-cdd2-4222-95b4-bafd614b7460" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.693028] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0cb41b0f-cdd2-4222-95b4-bafd614b7460" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.693028] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.693028] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.693028] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.693282] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.693282] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.693282] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0cb41b0f-cdd2-4222-95b4-bafd614b7460',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1000.032857] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock network-949 taken with stack trace [, , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.033175] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "network-949" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.033218] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "network-949" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.033450] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "network-949" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.033700] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.033857] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.033971] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.034565] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.034845] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.035073] env[65306]: DEBUG dogpile.cache.region [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] No value present for key: 'zone-id' {{(pid=65306) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1000.036102] env[65306]: DEBUG dogpile.lock [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] NeedRegenerationException {{(pid=65306) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1000.036102] env[65306]: DEBUG dogpile.lock [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] no value, waiting for create lock {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1000.036102] env[65306]: DEBUG dogpile.lock [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] value creation lock acquired {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1000.036315] env[65306]: DEBUG dogpile.cache.region [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] No value present for key: 'zone-id' {{(pid=65306) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1000.036315] env[65306]: DEBUG dogpile.lock [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Calling creation function for not-yet-present value {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1000.036585] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1000.060781] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1000.060964] env[65306]: DEBUG dogpile.cache.region [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65306) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1000.061275] env[65306]: DEBUG dogpile.lock [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Released creation lock {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1000.061473] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "network-949" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.061903] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock port-fcd8dac5-40f5-46f3-9502-ed3f09999b18 taken with stack trace [, , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.062123] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "port-fcd8dac5-40f5-46f3-9502-ed3f09999b18" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.062248] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "port-fcd8dac5-40f5-46f3-9502-ed3f09999b18" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.062610] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "port-fcd8dac5-40f5-46f3-9502-ed3f09999b18" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.062780] env[65306]: DEBUG networking_nsxv3.api.rpc [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fcd8dac5-40f5-46f3-9502-ed3f09999b18',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1000.196158] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0cb41b0f-cdd2-4222-95b4-bafd614b7460',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1000.566864] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.567263] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.567414] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.567700] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.567922] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.568176] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Segment Port fcd8dac5-40f5-46f3-9502-ed3f09999b18 not found, creating... [ 1000.568467] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.568637] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.568754] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.568983] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.569138] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.569421] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.569577] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.569692] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.569900] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.570045] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.570189] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Resource: SegmentPort with ID: fcd8dac5-40f5-46f3-9502-ed3f09999b18 is going to be created. [ 1000.592857] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.593122] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.593283] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.593558] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.593812] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.594133] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "port-fcd8dac5-40f5-46f3-9502-ed3f09999b18" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.699070] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0cb41b0f-cdd2-4222-95b4-bafd614b7460',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1000.860372] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7b301620-e19b-4a95-9103-ce7982b7fa1d in Status: SUCCESS [ 1000.860612] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7b301620-e19b-4a95-9103-ce7982b7fa1d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.928382] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 57bb6fe9-98c4-47f0-9daa-c424a0c9dfee in Status: SUCCESS [ 1000.928382] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-57bb6fe9-98c4-47f0-9daa-c424a0c9dfee" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.928978] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-57bb6fe9-98c4-47f0-9daa-c424a0c9dfee" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.929217] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-57bb6fe9-98c4-47f0-9daa-c424a0c9dfee" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.929410] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.929575] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.929662] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.929853] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.929962] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.930613] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('57bb6fe9-98c4-47f0-9daa-c424a0c9dfee',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1001.201466] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.202647] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.202647] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.202647] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.202647] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.202647] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0cb41b0f-cdd2-4222-95b4-bafd614b7460 is going to be updated. [ 1001.233653] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.233841] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.233898] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.234487] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.234487] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.244495] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0cb41b0f-cdd2-4222-95b4-bafd614b7460 in Status: IN_PROGRESS for 2s [ 1001.352913] env[65306]: INFO networking_nsxv3.common.synchronization [req-49e74943-3179-4e5c-9fa7-3b1947559f34 req-0be73862-b270-4a47-a0fa-777a14fae13f service nova] Enqueued Resource ID: 0cb41b0f-cdd2-4222-95b4-bafd614b7460 with Priority: HIGHEST for action security_group_rules [ 1001.353248] env[65306]: INFO networking_nsxv3.common.synchronization [req-49e74943-3179-4e5c-9fa7-3b1947559f34 req-0be73862-b270-4a47-a0fa-777a14fae13f service nova] Enqueued Resource ID: 0cb41b0f-cdd2-4222-95b4-bafd614b7460 with Priority: HIGHEST for action security_group_members [ 1001.353910] env[65306]: INFO networking_nsxv3.common.synchronization [req-49e74943-3179-4e5c-9fa7-3b1947559f34 req-0be73862-b270-4a47-a0fa-777a14fae13f service nova] Enqueued Resource ID: fcd8dac5-40f5-46f3-9502-ed3f09999b18 with Priority: HIGHEST for action port [ 1001.354214] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0cb41b0f-cdd2-4222-95b4-bafd614b7460 with Priority: HIGHEST for action security_group_rules [ 1001.354382] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0cb41b0f-cdd2-4222-95b4-bafd614b7460 with Priority: HIGHEST for action security_group_members [ 1001.354586] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fcd8dac5-40f5-46f3-9502-ed3f09999b18 with Priority: HIGHEST for action port [ 1001.354943] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0cb41b0f-cdd2-4222-95b4-bafd614b7460 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.355128] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0cb41b0f-cdd2-4222-95b4-bafd614b7460" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.355230] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0cb41b0f-cdd2-4222-95b4-bafd614b7460" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.355511] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0cb41b0f-cdd2-4222-95b4-bafd614b7460" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.355632] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0cb41b0f-cdd2-4222-95b4-bafd614b7460',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1001.356834] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-0cb41b0f-cdd2-4222-95b4-bafd614b7460 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.357587] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0cb41b0f-cdd2-4222-95b4-bafd614b7460" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.357587] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock port-fcd8dac5-40f5-46f3-9502-ed3f09999b18 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.357587] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fcd8dac5-40f5-46f3-9502-ed3f09999b18" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.357587] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fcd8dac5-40f5-46f3-9502-ed3f09999b18" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.358107] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fcd8dac5-40f5-46f3-9502-ed3f09999b18" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.358107] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fcd8dac5-40f5-46f3-9502-ed3f09999b18',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1001.428783] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d7a326c8-f35c-48c1-831b-ebd2cbb656e7 in Status: SUCCESS [ 1001.429030] env[65306]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d7a326c8-f35c-48c1-831b-ebd2cbb656e7 deletion is rescheduled due to dependency. [ 1001.429872] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d7a326c8-f35c-48c1-831b-ebd2cbb656e7" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.430101] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 56904b3c-38e4-4547-9a1d-cc787c3fef9d in Status: SUCCESS [ 1001.430784] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-56904b3c-38e4-4547-9a1d-cc787c3fef9d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.432622] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('57bb6fe9-98c4-47f0-9daa-c424a0c9dfee',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1001.860676] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-0cb41b0f-cdd2-4222-95b4-bafd614b7460 taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.860839] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0cb41b0f-cdd2-4222-95b4-bafd614b7460" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.861244] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port fcd8dac5-40f5-46f3-9502-ed3f09999b18 with status ACTIVE [ 1001.861244] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.861338] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.861415] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.861650] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.861753] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.861950] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.862063] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.862127] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.862278] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.862352] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.862531] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.862645] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.862699] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.862842] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.862916] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.863042] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: fcd8dac5-40f5-46f3-9502-ed3f09999b18 is going to be updated. [ 1001.893190] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.893190] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.893190] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.893340] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.893411] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.893588] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fcd8dac5-40f5-46f3-9502-ed3f09999b18" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.934867] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('57bb6fe9-98c4-47f0-9daa-c424a0c9dfee',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1002.440437] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.440437] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.440437] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.440437] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.440437] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.440437] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 57bb6fe9-98c4-47f0-9daa-c424a0c9dfee is going to be updated. [ 1002.471987] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.471987] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.471987] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.471987] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.471987] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.481418] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 57bb6fe9-98c4-47f0-9daa-c424a0c9dfee in Status: IN_PROGRESS for 2s [ 1003.255338] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0cb41b0f-cdd2-4222-95b4-bafd614b7460 in Status: SUCCESS [ 1003.255468] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0cb41b0f-cdd2-4222-95b4-bafd614b7460" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.255640] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0cb41b0f-cdd2-4222-95b4-bafd614b7460" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.255885] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0cb41b0f-cdd2-4222-95b4-bafd614b7460" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.256104] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.256248] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.256313] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.256496] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.256589] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.256709] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0cb41b0f-cdd2-4222-95b4-bafd614b7460',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1003.759467] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0cb41b0f-cdd2-4222-95b4-bafd614b7460',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1004.262634] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0cb41b0f-cdd2-4222-95b4-bafd614b7460',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1004.492754] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 57bb6fe9-98c4-47f0-9daa-c424a0c9dfee in Status: SUCCESS [ 1004.492990] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-57bb6fe9-98c4-47f0-9daa-c424a0c9dfee" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.493226] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-57bb6fe9-98c4-47f0-9daa-c424a0c9dfee" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.494180] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-57bb6fe9-98c4-47f0-9daa-c424a0c9dfee" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.494180] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.494180] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.494180] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.494180] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.494417] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.494417] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-57bb6fe9-98c4-47f0-9daa-c424a0c9dfee" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.494417] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('57bb6fe9-98c4-47f0-9daa-c424a0c9dfee',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1004.765551] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.765863] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.765863] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.766018] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.766112] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.766211] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0cb41b0f-cdd2-4222-95b4-bafd614b7460 is going to be updated. [ 1004.802113] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.802113] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.802113] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.802113] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.802113] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.831910] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0cb41b0f-cdd2-4222-95b4-bafd614b7460 in Status: IN_PROGRESS for 2s [ 1004.997685] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-57bb6fe9-98c4-47f0-9daa-c424a0c9dfee taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.997909] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-57bb6fe9-98c4-47f0-9daa-c424a0c9dfee" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.998059] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-57bb6fe9-98c4-47f0-9daa-c424a0c9dfee" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.998300] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-57bb6fe9-98c4-47f0-9daa-c424a0c9dfee" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.998481] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.998585] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.998647] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.998800] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.998888] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.998973] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-57bb6fe9-98c4-47f0-9daa-c424a0c9dfee" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.999143] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-57bb6fe9-98c4-47f0-9daa-c424a0c9dfee taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.999297] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-57bb6fe9-98c4-47f0-9daa-c424a0c9dfee" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.999297] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-57bb6fe9-98c4-47f0-9daa-c424a0c9dfee" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.999447] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-57bb6fe9-98c4-47f0-9daa-c424a0c9dfee" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.999585] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.999678] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.999732] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.999867] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.999941] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.000033] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-57bb6fe9-98c4-47f0-9daa-c424a0c9dfee" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.000123] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('57bb6fe9-98c4-47f0-9daa-c424a0c9dfee',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1005.502376] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 57bb6fe9-98c4-47f0-9daa-c424a0c9dfee: rpc.has_security_group_logging(os_id): False [ 1005.525567] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.525867] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.526011] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.526302] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.526420] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.527475] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.527475] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.527475] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.527475] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.527475] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.527475] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.527475] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.527475] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.527906] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.527906] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.527906] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.527906] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.528063] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.528144] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.528180] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.528314] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 57bb6fe9-98c4-47f0-9daa-c424a0c9dfee is going to be updated. [ 1005.611065] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.611255] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.611302] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.611536] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.611872] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.645500] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 57bb6fe9-98c4-47f0-9daa-c424a0c9dfee in Status: IN_PROGRESS for 2s [ 1006.355900] env[65306]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1006.356302] env[65306]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=3 [ 1006.844907] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0cb41b0f-cdd2-4222-95b4-bafd614b7460 in Status: SUCCESS [ 1006.845210] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0cb41b0f-cdd2-4222-95b4-bafd614b7460" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.845384] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0cb41b0f-cdd2-4222-95b4-bafd614b7460" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.845643] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0cb41b0f-cdd2-4222-95b4-bafd614b7460" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.845897] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.846038] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.846110] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.846318] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.846408] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.846508] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0cb41b0f-cdd2-4222-95b4-bafd614b7460" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.846615] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0cb41b0f-cdd2-4222-95b4-bafd614b7460',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1007.349341] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-0cb41b0f-cdd2-4222-95b4-bafd614b7460 taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.349578] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0cb41b0f-cdd2-4222-95b4-bafd614b7460" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.349666] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0cb41b0f-cdd2-4222-95b4-bafd614b7460" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.349904] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0cb41b0f-cdd2-4222-95b4-bafd614b7460" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.350095] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.350209] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.350299] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.350482] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.350573] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.350664] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0cb41b0f-cdd2-4222-95b4-bafd614b7460" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.350820] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-0cb41b0f-cdd2-4222-95b4-bafd614b7460 taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.350991] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0cb41b0f-cdd2-4222-95b4-bafd614b7460" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.351074] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0cb41b0f-cdd2-4222-95b4-bafd614b7460" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.351285] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0cb41b0f-cdd2-4222-95b4-bafd614b7460" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.351448] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.351549] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.351658] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.351776] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.351858] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.351941] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0cb41b0f-cdd2-4222-95b4-bafd614b7460" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.352899] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0cb41b0f-cdd2-4222-95b4-bafd614b7460',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1007.637343] env[65306]: INFO networking_nsxv3.common.synchronization [req-b48bfb77-46ba-4e71-8e14-a5f4b226ab34 req-1a55d2cd-1302-4151-9838-f7b43194bbc9 tempest-ListServerFiltersTestJSON-702113484 tempest-ListServerFiltersTestJSON-702113484-project-member] Enqueued Resource ID: a3364d7c-b2fd-4f01-932a-1feef0fa76de with Priority: HIGHEST for action security_group_members [ 1007.637343] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a3364d7c-b2fd-4f01-932a-1feef0fa76de with Priority: HIGHEST for action security_group_members [ 1007.637343] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-a3364d7c-b2fd-4f01-932a-1feef0fa76de taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.637343] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a3364d7c-b2fd-4f01-932a-1feef0fa76de" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.637343] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a3364d7c-b2fd-4f01-932a-1feef0fa76de" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.637343] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a3364d7c-b2fd-4f01-932a-1feef0fa76de" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.637956] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.637956] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.637956] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.637956] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.637956] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.637956] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a3364d7c-b2fd-4f01-932a-1feef0fa76de',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1007.663299] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 57bb6fe9-98c4-47f0-9daa-c424a0c9dfee in Status: SUCCESS [ 1007.663568] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-57bb6fe9-98c4-47f0-9daa-c424a0c9dfee" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.687032] env[65306]: INFO networking_nsxv3.common.synchronization [req-79f41974-d046-4ed5-8474-4449fe504ad6 req-e8f93e6c-043c-4e04-a162-3f9fafb2e642 tempest-TenantUsagesTestJSON-2047512986 tempest-TenantUsagesTestJSON-2047512986-project-member] Enqueued Resource ID: 7b301620-e19b-4a95-9103-ce7982b7fa1d with Priority: HIGHEST for action security_group_members [ 1007.687601] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7b301620-e19b-4a95-9103-ce7982b7fa1d with Priority: HIGHEST for action security_group_members [ 1007.688936] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-7b301620-e19b-4a95-9103-ce7982b7fa1d taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.688936] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7b301620-e19b-4a95-9103-ce7982b7fa1d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.688936] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7b301620-e19b-4a95-9103-ce7982b7fa1d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.688936] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7b301620-e19b-4a95-9103-ce7982b7fa1d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.689384] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.689556] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.689675] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.689938] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.690292] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.690424] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7b301620-e19b-4a95-9103-ce7982b7fa1d',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1007.857565] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0cb41b0f-cdd2-4222-95b4-bafd614b7460: rpc.has_security_group_logging(os_id): False [ 1007.885497] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.885802] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.885958] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.886355] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.886525] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.886901] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.887049] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.887121] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.887372] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.887417] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.887625] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.887738] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.887773] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.887924] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.887992] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.888293] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.888393] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.888445] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.888590] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.888664] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.888756] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0cb41b0f-cdd2-4222-95b4-bafd614b7460 is going to be updated. [ 1008.012363] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.012483] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.012530] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.012739] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.012892] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.053119] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0cb41b0f-cdd2-4222-95b4-bafd614b7460 in Status: IN_PROGRESS for 2s [ 1008.140867] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.141159] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.141350] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.141750] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.141844] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.142101] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.142213] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.142276] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.142479] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.142589] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.142649] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a3364d7c-b2fd-4f01-932a-1feef0fa76de is going to be updated. [ 1008.180671] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.180895] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.180983] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.181331] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.181495] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.193444] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.193776] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.193879] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.194372] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.194547] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.194874] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.195068] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.195230] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.195553] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.195701] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.195855] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7b301620-e19b-4a95-9103-ce7982b7fa1d is going to be updated. [ 1008.200034] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a3364d7c-b2fd-4f01-932a-1feef0fa76de in Status: IN_PROGRESS for 2s [ 1008.238145] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.238645] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.238645] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.238875] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.238952] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.250509] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7b301620-e19b-4a95-9103-ce7982b7fa1d in Status: IN_PROGRESS for 2s [ 1009.968191] env[65306]: INFO networking_nsxv3.common.synchronization [None req-5a495185-7950-4601-8af1-9445f53a89d1 tempest-AttachVolumeNegativeTest-723798471 tempest-AttachVolumeNegativeTest-723798471-project-member] Enqueued Resource ID: 7f22d913-90d3-4ccb-8780-b9dbc479a7d3 with Priority: HIGHEST for action security_group_rules [ 1009.968900] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7f22d913-90d3-4ccb-8780-b9dbc479a7d3 with Priority: HIGHEST for action security_group_rules [ 1009.972195] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7f22d913-90d3-4ccb-8780-b9dbc479a7d3 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.972195] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7f22d913-90d3-4ccb-8780-b9dbc479a7d3" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.972195] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7f22d913-90d3-4ccb-8780-b9dbc479a7d3" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.972195] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7f22d913-90d3-4ccb-8780-b9dbc479a7d3" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.972195] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7f22d913-90d3-4ccb-8780-b9dbc479a7d3',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1010.072482] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0cb41b0f-cdd2-4222-95b4-bafd614b7460 in Status: SUCCESS [ 1010.072837] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0cb41b0f-cdd2-4222-95b4-bafd614b7460" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.084882] env[65306]: INFO networking_nsxv3.common.synchronization [None req-55c4160f-3195-4115-83cc-e68d7c87ef14 tempest-AttachVolumeNegativeTest-723798471 tempest-AttachVolumeNegativeTest-723798471-project-member] Enqueued Resource ID: 7f22d913-90d3-4ccb-8780-b9dbc479a7d3 with Priority: HIGHEST for action security_group_rules [ 1010.086849] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7f22d913-90d3-4ccb-8780-b9dbc479a7d3 with Priority: HIGHEST for action security_group_rules [ 1010.087064] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7f22d913-90d3-4ccb-8780-b9dbc479a7d3 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.087274] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7f22d913-90d3-4ccb-8780-b9dbc479a7d3" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.211456] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a3364d7c-b2fd-4f01-932a-1feef0fa76de in Status: SUCCESS [ 1010.211456] env[65306]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a3364d7c-b2fd-4f01-932a-1feef0fa76de deletion is rescheduled due to dependency. [ 1010.211456] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a3364d7c-b2fd-4f01-932a-1feef0fa76de" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.261198] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7b301620-e19b-4a95-9103-ce7982b7fa1d in Status: SUCCESS [ 1010.261267] env[65306]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7b301620-e19b-4a95-9103-ce7982b7fa1d deletion is rescheduled due to dependency. [ 1010.261395] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7b301620-e19b-4a95-9103-ce7982b7fa1d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.496599] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.497823] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.497823] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.497823] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.497823] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.497823] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7f22d913-90d3-4ccb-8780-b9dbc479a7d3 already deleted. [ 1010.497823] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7f22d913-90d3-4ccb-8780-b9dbc479a7d3" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.497823] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7f22d913-90d3-4ccb-8780-b9dbc479a7d3" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.497823] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7f22d913-90d3-4ccb-8780-b9dbc479a7d3" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.497823] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7f22d913-90d3-4ccb-8780-b9dbc479a7d3',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1011.024188] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.024505] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.024505] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.024623] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.024692] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.024804] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7f22d913-90d3-4ccb-8780-b9dbc479a7d3 already deleted. [ 1011.024896] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7f22d913-90d3-4ccb-8780-b9dbc479a7d3" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.411798] env[65306]: INFO networking_nsxv3.common.synchronization [req-7d4eba1b-dea8-47b1-a2ba-59a5f6c8af5b req-9c56e2dd-fd5f-4616-b7db-fa7addb218c0 tempest-ServersTestJSON-1773114292 tempest-ServersTestJSON-1773114292-project-member] Enqueued Resource ID: 0cb41b0f-cdd2-4222-95b4-bafd614b7460 with Priority: HIGHEST for action security_group_members [ 1012.412363] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0cb41b0f-cdd2-4222-95b4-bafd614b7460 with Priority: HIGHEST for action security_group_members [ 1012.412703] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-0cb41b0f-cdd2-4222-95b4-bafd614b7460 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.412840] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0cb41b0f-cdd2-4222-95b4-bafd614b7460" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.413014] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0cb41b0f-cdd2-4222-95b4-bafd614b7460" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.413213] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0cb41b0f-cdd2-4222-95b4-bafd614b7460" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.413370] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.413467] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.413530] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.413676] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.413830] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.413879] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0cb41b0f-cdd2-4222-95b4-bafd614b7460',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1012.916167] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0cb41b0f-cdd2-4222-95b4-bafd614b7460',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1013.418937] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0cb41b0f-cdd2-4222-95b4-bafd614b7460',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1013.923719] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.923719] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.923719] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.923719] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.923719] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.923719] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0cb41b0f-cdd2-4222-95b4-bafd614b7460 is going to be updated. [ 1013.959901] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.960096] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.960223] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.960328] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.960475] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.972590] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0cb41b0f-cdd2-4222-95b4-bafd614b7460 in Status: IN_PROGRESS for 2s [ 1015.123142] env[65306]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-fe90dfa9-7944-46fc-be94-0b3a151ba91d None None] NSXv3 Agent Agent loop - iteration:1 completed [ 1015.123526] env[65306]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-fe90dfa9-7944-46fc-be94-0b3a151ba91d None None] NSXv3 Agent Agent loop - iteration:2 started [ 1015.987155] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0cb41b0f-cdd2-4222-95b4-bafd614b7460 in Status: SUCCESS [ 1015.987407] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0cb41b0f-cdd2-4222-95b4-bafd614b7460" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.194508] env[65306]: INFO networking_nsxv3.common.synchronization [req-72cf3ec1-e0cf-4e6c-964a-7b8713124d39 req-cb93d4b6-ea1f-4c49-a8de-981f79eaae20 tempest-ServersAdminTestJSON-2076938379 tempest-ServersAdminTestJSON-2076938379-project-member] Enqueued Resource ID: 56904b3c-38e4-4547-9a1d-cc787c3fef9d with Priority: HIGHEST for action security_group_members [ 1016.194508] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 56904b3c-38e4-4547-9a1d-cc787c3fef9d with Priority: HIGHEST for action security_group_members [ 1016.194508] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-56904b3c-38e4-4547-9a1d-cc787c3fef9d taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.194508] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-56904b3c-38e4-4547-9a1d-cc787c3fef9d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.194508] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-56904b3c-38e4-4547-9a1d-cc787c3fef9d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.194508] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-56904b3c-38e4-4547-9a1d-cc787c3fef9d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.194508] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.194957] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.194957] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.194957] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.194957] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.195115] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('56904b3c-38e4-4547-9a1d-cc787c3fef9d',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1016.698039] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('56904b3c-38e4-4547-9a1d-cc787c3fef9d',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1017.200330] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('56904b3c-38e4-4547-9a1d-cc787c3fef9d',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1017.703258] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.703408] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.703482] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.703694] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.703786] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.703888] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 56904b3c-38e4-4547-9a1d-cc787c3fef9d is going to be updated. [ 1017.734471] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.734628] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.734628] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.735412] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.735412] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.745905] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 56904b3c-38e4-4547-9a1d-cc787c3fef9d in Status: IN_PROGRESS for 2s [ 1019.004933] env[65306]: INFO networking_nsxv3.common.synchronization [req-973c4256-4518-4f23-ace8-0ca041273a9d req-25355ec8-6733-4513-b051-ac4a71d5d375 tempest-ImagesTestJSON-762064805 tempest-ImagesTestJSON-762064805-project-member] Enqueued Resource ID: 57bb6fe9-98c4-47f0-9daa-c424a0c9dfee with Priority: HIGHEST for action security_group_members [ 1019.005286] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 57bb6fe9-98c4-47f0-9daa-c424a0c9dfee with Priority: HIGHEST for action security_group_members [ 1019.005611] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-57bb6fe9-98c4-47f0-9daa-c424a0c9dfee taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.005740] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-57bb6fe9-98c4-47f0-9daa-c424a0c9dfee" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.005829] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-57bb6fe9-98c4-47f0-9daa-c424a0c9dfee" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.006042] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-57bb6fe9-98c4-47f0-9daa-c424a0c9dfee" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.006203] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.006331] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.006405] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.006536] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.006587] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.006683] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('57bb6fe9-98c4-47f0-9daa-c424a0c9dfee',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1019.463570] env[65306]: INFO networking_nsxv3.common.synchronization [None req-0de47a7d-ed9d-4665-87d8-6a9fad43f0ab tempest-ServerDiskConfigTestJSON-771154958 tempest-ServerDiskConfigTestJSON-771154958-project-member] Enqueued Resource ID: fa3c935e-0d42-4835-8c59-b298f8d14c41 with Priority: HIGHEST for action security_group_rules [ 1019.464142] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fa3c935e-0d42-4835-8c59-b298f8d14c41 with Priority: HIGHEST for action security_group_rules [ 1019.464459] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fa3c935e-0d42-4835-8c59-b298f8d14c41 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.464592] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fa3c935e-0d42-4835-8c59-b298f8d14c41" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.464662] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fa3c935e-0d42-4835-8c59-b298f8d14c41" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.464933] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fa3c935e-0d42-4835-8c59-b298f8d14c41" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.465086] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fa3c935e-0d42-4835-8c59-b298f8d14c41',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1019.508382] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('57bb6fe9-98c4-47f0-9daa-c424a0c9dfee',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1019.570953] env[65306]: INFO networking_nsxv3.common.synchronization [None req-31da330c-2aad-4a7a-9af3-51c9973e59ae tempest-ServerDiskConfigTestJSON-771154958 tempest-ServerDiskConfigTestJSON-771154958-project-member] Enqueued Resource ID: fa3c935e-0d42-4835-8c59-b298f8d14c41 with Priority: HIGHEST for action security_group_rules [ 1019.571849] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fa3c935e-0d42-4835-8c59-b298f8d14c41 with Priority: HIGHEST for action security_group_rules [ 1019.572870] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fa3c935e-0d42-4835-8c59-b298f8d14c41 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.573096] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fa3c935e-0d42-4835-8c59-b298f8d14c41" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.761275] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 56904b3c-38e4-4547-9a1d-cc787c3fef9d in Status: SUCCESS [ 1019.761497] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-56904b3c-38e4-4547-9a1d-cc787c3fef9d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.986570] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.986719] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.986779] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.987088] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.987229] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.987421] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fa3c935e-0d42-4835-8c59-b298f8d14c41 already deleted. [ 1019.987576] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fa3c935e-0d42-4835-8c59-b298f8d14c41" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.987861] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fa3c935e-0d42-4835-8c59-b298f8d14c41" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.988159] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fa3c935e-0d42-4835-8c59-b298f8d14c41" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.988352] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fa3c935e-0d42-4835-8c59-b298f8d14c41',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1020.011085] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('57bb6fe9-98c4-47f0-9daa-c424a0c9dfee',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1020.510653] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.511302] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.511302] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.511302] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.511468] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.511468] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fa3c935e-0d42-4835-8c59-b298f8d14c41 already deleted. [ 1020.511537] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fa3c935e-0d42-4835-8c59-b298f8d14c41" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.513010] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.513126] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.513196] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.513360] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.513464] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.513533] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 57bb6fe9-98c4-47f0-9daa-c424a0c9dfee is going to be updated. [ 1020.555235] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.555394] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.555469] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.555692] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.555842] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.565235] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 57bb6fe9-98c4-47f0-9daa-c424a0c9dfee in Status: IN_PROGRESS for 2s [ 1022.577138] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 57bb6fe9-98c4-47f0-9daa-c424a0c9dfee in Status: SUCCESS [ 1022.577440] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-57bb6fe9-98c4-47f0-9daa-c424a0c9dfee" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.667221] env[65306]: INFO networking_nsxv3.common.synchronization [req-43493587-b93e-47ad-aee2-6a8747976bf3 req-fce72287-a44e-4c3e-9f75-62c8d2dce7f7 tempest-ServerDiskConfigTestJSON-771154958 tempest-ServerDiskConfigTestJSON-771154958-project-member] Enqueued Resource ID: 9e80329d-1fcd-4c50-8991-a90e2a1fbdbc with Priority: HIGHEST for action security_group_members [ 1022.667958] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9e80329d-1fcd-4c50-8991-a90e2a1fbdbc with Priority: HIGHEST for action security_group_members [ 1022.668085] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-9e80329d-1fcd-4c50-8991-a90e2a1fbdbc taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.668250] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9e80329d-1fcd-4c50-8991-a90e2a1fbdbc" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.668319] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9e80329d-1fcd-4c50-8991-a90e2a1fbdbc" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.668523] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9e80329d-1fcd-4c50-8991-a90e2a1fbdbc" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.668679] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.668774] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.668840] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.671109] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.671109] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.671109] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9e80329d-1fcd-4c50-8991-a90e2a1fbdbc',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1023.173451] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.173651] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.173716] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.173973] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.174149] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.174383] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.174484] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.174574] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.174970] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.174970] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.174970] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9e80329d-1fcd-4c50-8991-a90e2a1fbdbc is going to be updated. [ 1023.204272] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.204502] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.204502] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.204684] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.204835] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.214771] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9e80329d-1fcd-4c50-8991-a90e2a1fbdbc in Status: IN_PROGRESS for 2s [ 1025.231011] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9e80329d-1fcd-4c50-8991-a90e2a1fbdbc in Status: SUCCESS [ 1025.231349] env[65306]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9e80329d-1fcd-4c50-8991-a90e2a1fbdbc deletion is rescheduled due to dependency. [ 1025.231384] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9e80329d-1fcd-4c50-8991-a90e2a1fbdbc" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.219843] env[65306]: INFO networking_nsxv3.common.synchronization [req-3e62b72f-26bc-4806-b19e-7d3b7adf8f73 req-21237a90-c163-4deb-92ca-418da83093e4 tempest-DeleteServersTestJSON-1340326246 tempest-DeleteServersTestJSON-1340326246-project-member] Enqueued Resource ID: d82bad56-9830-4c7d-9763-6d8a05e0998c with Priority: HIGHEST for action security_group_members [ 1026.220738] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d82bad56-9830-4c7d-9763-6d8a05e0998c with Priority: HIGHEST for action security_group_members [ 1026.221584] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-d82bad56-9830-4c7d-9763-6d8a05e0998c taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.221584] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d82bad56-9830-4c7d-9763-6d8a05e0998c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.221584] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d82bad56-9830-4c7d-9763-6d8a05e0998c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.221584] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d82bad56-9830-4c7d-9763-6d8a05e0998c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.221584] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.221894] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.221894] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.221894] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.222034] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.222073] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d82bad56-9830-4c7d-9763-6d8a05e0998c',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1026.493885] env[65306]: INFO networking_nsxv3.common.synchronization [None req-d90759c1-eb05-4213-8257-93d36e478c28 None None] Enqueued Resource ID: df5ea757-fd69-4aae-ab27-eea5e451d91e with Priority: HIGHEST for action port [ 1026.496500] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: df5ea757-fd69-4aae-ab27-eea5e451d91e with Priority: HIGHEST for action port [ 1026.496500] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock port-df5ea757-fd69-4aae-ab27-eea5e451d91e taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.496500] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-df5ea757-fd69-4aae-ab27-eea5e451d91e" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.496500] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-df5ea757-fd69-4aae-ab27-eea5e451d91e" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.496500] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-df5ea757-fd69-4aae-ab27-eea5e451d91e" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.496500] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('df5ea757-fd69-4aae-ab27-eea5e451d91e',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1026.725067] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.725193] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.725236] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.725470] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.725569] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.725780] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.725882] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.725960] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.726204] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.726298] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.726394] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d82bad56-9830-4c7d-9763-6d8a05e0998c is going to be updated. [ 1026.767165] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.767433] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.767546] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.767855] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.768131] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.790059] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d82bad56-9830-4c7d-9763-6d8a05e0998c in Status: IN_PROGRESS for 2s [ 1026.873083] env[65306]: INFO networking_nsxv3.common.synchronization [None req-24c02f2e-d491-4c68-ae15-8dc1bcc91238 None None] Enqueued Resource ID: 7664d698-ae90-4de2-98dd-0b51aee05bba with Priority: HIGHEST for action port [ 1026.873792] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7664d698-ae90-4de2-98dd-0b51aee05bba with Priority: HIGHEST for action port [ 1026.874162] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock port-7664d698-ae90-4de2-98dd-0b51aee05bba taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.874296] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7664d698-ae90-4de2-98dd-0b51aee05bba" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.874415] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7664d698-ae90-4de2-98dd-0b51aee05bba" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.874630] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7664d698-ae90-4de2-98dd-0b51aee05bba" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.874719] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7664d698-ae90-4de2-98dd-0b51aee05bba',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1026.994155] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock network-591 taken with stack trace [, , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.994362] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "network-591" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.994488] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "network-591" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.994753] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "network-591" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.995050] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.995216] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.995333] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.995559] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.995707] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.995921] env[65306]: DEBUG dogpile.cache.region [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] No value present for key: 'zone-id' {{(pid=65306) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1026.996049] env[65306]: DEBUG dogpile.lock [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] NeedRegenerationException {{(pid=65306) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1026.996184] env[65306]: DEBUG dogpile.lock [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] no value, waiting for create lock {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1026.997289] env[65306]: DEBUG dogpile.lock [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] value creation lock acquired {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1026.997289] env[65306]: DEBUG dogpile.cache.region [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] No value present for key: 'zone-id' {{(pid=65306) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1026.997289] env[65306]: DEBUG dogpile.lock [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Calling creation function for not-yet-present value {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1026.997289] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1026.999069] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port df5ea757-fd69-4aae-ab27-eea5e451d91e [ 1026.999069] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.999069] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.999069] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.999069] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.999069] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.999069] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:df5ea757-fd69-4aae-ab27-eea5e451d91e already deleted. [ 1026.999069] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-df5ea757-fd69-4aae-ab27-eea5e451d91e" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.019468] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1027.019679] env[65306]: DEBUG dogpile.cache.region [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65306) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1027.020114] env[65306]: DEBUG dogpile.lock [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Released creation lock {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1027.020212] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "network-591" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.020585] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock port-50b6a1f0-2c65-4518-8eec-e1dfcb1a21cf taken with stack trace [, , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.020826] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "port-50b6a1f0-2c65-4518-8eec-e1dfcb1a21cf" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.020990] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "port-50b6a1f0-2c65-4518-8eec-e1dfcb1a21cf" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.021382] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "port-50b6a1f0-2c65-4518-8eec-e1dfcb1a21cf" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.021520] env[65306]: DEBUG networking_nsxv3.api.rpc [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('50b6a1f0-2c65-4518-8eec-e1dfcb1a21cf',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1027.379099] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7664d698-ae90-4de2-98dd-0b51aee05bba [ 1027.379099] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.379351] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.379351] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.379860] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.379860] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.379860] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7664d698-ae90-4de2-98dd-0b51aee05bba already deleted. [ 1027.379860] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7664d698-ae90-4de2-98dd-0b51aee05bba" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.524376] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.524681] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.524737] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.525031] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.527430] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.527736] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Segment Port 50b6a1f0-2c65-4518-8eec-e1dfcb1a21cf not found, creating... [ 1027.528039] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.528215] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.528330] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.528577] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.528715] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.529023] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.529177] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.529289] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.529521] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.529630] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.529765] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Resource: SegmentPort with ID: 50b6a1f0-2c65-4518-8eec-e1dfcb1a21cf is going to be created. [ 1027.556823] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.557051] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.557284] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.557451] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.558768] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.558768] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "port-50b6a1f0-2c65-4518-8eec-e1dfcb1a21cf" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.367490] env[65306]: INFO networking_nsxv3.common.synchronization [req-3e62b72f-26bc-4806-b19e-7d3b7adf8f73 req-5f9ab918-1dc4-4b55-afd3-0a23f9ea0fe3 service nova] Enqueued Resource ID: d82bad56-9830-4c7d-9763-6d8a05e0998c with Priority: HIGHEST for action security_group_rules [ 1028.370155] env[65306]: INFO networking_nsxv3.common.synchronization [req-3e62b72f-26bc-4806-b19e-7d3b7adf8f73 req-5f9ab918-1dc4-4b55-afd3-0a23f9ea0fe3 service nova] Enqueued Resource ID: d82bad56-9830-4c7d-9763-6d8a05e0998c with Priority: HIGHEST for action security_group_members [ 1028.370155] env[65306]: INFO networking_nsxv3.common.synchronization [req-3e62b72f-26bc-4806-b19e-7d3b7adf8f73 req-5f9ab918-1dc4-4b55-afd3-0a23f9ea0fe3 service nova] Enqueued Resource ID: 50b6a1f0-2c65-4518-8eec-e1dfcb1a21cf with Priority: HIGHEST for action port [ 1028.370155] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d82bad56-9830-4c7d-9763-6d8a05e0998c with Priority: HIGHEST for action security_group_rules [ 1028.370155] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d82bad56-9830-4c7d-9763-6d8a05e0998c with Priority: HIGHEST for action security_group_members [ 1028.370155] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 50b6a1f0-2c65-4518-8eec-e1dfcb1a21cf with Priority: HIGHEST for action port [ 1028.370155] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d82bad56-9830-4c7d-9763-6d8a05e0998c taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.370155] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d82bad56-9830-4c7d-9763-6d8a05e0998c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.370155] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d82bad56-9830-4c7d-9763-6d8a05e0998c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.370628] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d82bad56-9830-4c7d-9763-6d8a05e0998c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.370628] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d82bad56-9830-4c7d-9763-6d8a05e0998c',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1028.371603] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-d82bad56-9830-4c7d-9763-6d8a05e0998c taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.371603] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d82bad56-9830-4c7d-9763-6d8a05e0998c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.371890] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock port-50b6a1f0-2c65-4518-8eec-e1dfcb1a21cf taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.372728] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-50b6a1f0-2c65-4518-8eec-e1dfcb1a21cf" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.372728] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-50b6a1f0-2c65-4518-8eec-e1dfcb1a21cf" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.372728] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-50b6a1f0-2c65-4518-8eec-e1dfcb1a21cf" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.372728] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('50b6a1f0-2c65-4518-8eec-e1dfcb1a21cf',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1028.633886] env[65306]: INFO networking_nsxv3.common.synchronization [req-bf64f492-a641-49bb-ba69-bbcace4eef34 req-7e1b8ce5-7670-4425-a03e-c9cce5933d05 tempest-AttachVolumeNegativeTest-723798471 tempest-AttachVolumeNegativeTest-723798471-project-member] Enqueued Resource ID: 7f22d913-90d3-4ccb-8780-b9dbc479a7d3 with Priority: HIGHEST for action security_group_members [ 1028.633886] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7f22d913-90d3-4ccb-8780-b9dbc479a7d3 with Priority: HIGHEST for action security_group_members [ 1028.633886] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-7f22d913-90d3-4ccb-8780-b9dbc479a7d3 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.634439] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7f22d913-90d3-4ccb-8780-b9dbc479a7d3" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.634439] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7f22d913-90d3-4ccb-8780-b9dbc479a7d3" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.634439] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7f22d913-90d3-4ccb-8780-b9dbc479a7d3" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.634585] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.634726] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.634805] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.635152] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.635152] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.635261] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7f22d913-90d3-4ccb-8780-b9dbc479a7d3',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1028.801148] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d82bad56-9830-4c7d-9763-6d8a05e0998c in Status: SUCCESS [ 1028.801148] env[65306]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d82bad56-9830-4c7d-9763-6d8a05e0998c deletion is rescheduled due to dependency. [ 1028.801341] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d82bad56-9830-4c7d-9763-6d8a05e0998c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.801417] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d82bad56-9830-4c7d-9763-6d8a05e0998c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.801618] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d82bad56-9830-4c7d-9763-6d8a05e0998c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.801812] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.801994] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.802088] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.802269] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.803354] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.803354] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d82bad56-9830-4c7d-9763-6d8a05e0998c',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1028.874338] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-d82bad56-9830-4c7d-9763-6d8a05e0998c taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.874471] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d82bad56-9830-4c7d-9763-6d8a05e0998c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.878297] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 50b6a1f0-2c65-4518-8eec-e1dfcb1a21cf with status ACTIVE [ 1028.878297] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.878297] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.878297] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.878297] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.878297] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.878297] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.878297] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.878297] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.878297] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.878297] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.878297] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.878297] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.878297] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.878297] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.878297] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.878297] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 50b6a1f0-2c65-4518-8eec-e1dfcb1a21cf is going to be updated. [ 1028.900358] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.900531] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.900611] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.901548] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.901548] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.901548] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-50b6a1f0-2c65-4518-8eec-e1dfcb1a21cf" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.111075] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock network-638 taken with stack trace [, , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.111352] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "network-638" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.111481] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "network-638" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.111765] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "network-638" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.112701] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.113565] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.113565] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.113565] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.113736] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.113930] env[65306]: DEBUG dogpile.cache.region [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] No value present for key: 'zone-id' {{(pid=65306) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1029.114061] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] NeedRegenerationException {{(pid=65306) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1029.114234] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] no value, waiting for create lock {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1029.114346] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] value creation lock acquired {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1029.114456] env[65306]: DEBUG dogpile.cache.region [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] No value present for key: 'zone-id' {{(pid=65306) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1029.114589] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Calling creation function for not-yet-present value {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1029.114766] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1029.139095] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1029.139413] env[65306]: DEBUG dogpile.cache.region [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65306) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1029.139588] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Released creation lock {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1029.139776] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "network-638" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.140652] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock port-b0dc9a2a-f5aa-4df0-9754-4b8b78204191 taken with stack trace [, , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.140652] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "port-b0dc9a2a-f5aa-4df0-9754-4b8b78204191" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.140652] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "port-b0dc9a2a-f5aa-4df0-9754-4b8b78204191" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.140927] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "port-b0dc9a2a-f5aa-4df0-9754-4b8b78204191" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.141116] env[65306]: DEBUG networking_nsxv3.api.rpc [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b0dc9a2a-f5aa-4df0-9754-4b8b78204191',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1029.142585] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.142585] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.142585] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.142783] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.143040] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.143336] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.143433] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.143520] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.143731] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.143832] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.143950] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7f22d913-90d3-4ccb-8780-b9dbc479a7d3 already deleted. [ 1029.144108] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7f22d913-90d3-4ccb-8780-b9dbc479a7d3" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.305426] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d82bad56-9830-4c7d-9763-6d8a05e0998c',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1029.552380] env[65306]: INFO networking_nsxv3.common.synchronization [None req-b80d93c2-9aaa-46a5-818d-96546037d3ac None None] Enqueued Resource ID: a3b943ce-32bb-4a2c-a815-6913107bd68a with Priority: HIGHEST for action port [ 1029.552997] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a3b943ce-32bb-4a2c-a815-6913107bd68a with Priority: HIGHEST for action port [ 1029.553298] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock port-a3b943ce-32bb-4a2c-a815-6913107bd68a taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.553429] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a3b943ce-32bb-4a2c-a815-6913107bd68a" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.553497] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a3b943ce-32bb-4a2c-a815-6913107bd68a" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.553808] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a3b943ce-32bb-4a2c-a815-6913107bd68a" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.553894] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a3b943ce-32bb-4a2c-a815-6913107bd68a',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1029.647529] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.647916] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.647916] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.648250] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.648410] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.648567] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Segment Port b0dc9a2a-f5aa-4df0-9754-4b8b78204191 not found, creating... [ 1029.648826] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.648987] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.649121] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.649362] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.649501] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.649934] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.650064] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.650224] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.650444] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.650582] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.650722] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Resource: SegmentPort with ID: b0dc9a2a-f5aa-4df0-9754-4b8b78204191 is going to be created. [ 1029.677036] env[65306]: INFO networking_nsxv3.common.synchronization [None req-fb88fcbc-0eae-425b-b309-b018112688d7 None None] Enqueued Resource ID: 92dd8d59-889e-4330-b9e1-7afee1098323 with Priority: HIGHEST for action port [ 1029.678211] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.678398] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.681060] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.681060] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.681060] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.681892] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "port-b0dc9a2a-f5aa-4df0-9754-4b8b78204191" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.682909] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 92dd8d59-889e-4330-b9e1-7afee1098323 with Priority: HIGHEST for action port [ 1029.683227] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock port-92dd8d59-889e-4330-b9e1-7afee1098323 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.683346] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-92dd8d59-889e-4330-b9e1-7afee1098323" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.683415] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-92dd8d59-889e-4330-b9e1-7afee1098323" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.683657] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-92dd8d59-889e-4330-b9e1-7afee1098323" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.683741] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('92dd8d59-889e-4330-b9e1-7afee1098323',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1029.807407] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d82bad56-9830-4c7d-9763-6d8a05e0998c',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1030.060478] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a3b943ce-32bb-4a2c-a815-6913107bd68a [ 1030.061155] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.061155] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.061155] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.061155] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.061155] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.061445] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a3b943ce-32bb-4a2c-a815-6913107bd68a already deleted. [ 1030.061445] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a3b943ce-32bb-4a2c-a815-6913107bd68a" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.188903] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 92dd8d59-889e-4330-b9e1-7afee1098323 [ 1030.188903] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.188903] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.188903] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.189317] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.189317] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.189317] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:92dd8d59-889e-4330-b9e1-7afee1098323 already deleted. [ 1030.189317] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-92dd8d59-889e-4330-b9e1-7afee1098323" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.310440] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.310440] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.310440] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.310685] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.310685] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.310749] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d82bad56-9830-4c7d-9763-6d8a05e0998c is going to be updated. [ 1030.341152] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.341395] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.341773] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.341773] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.341952] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.362760] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d82bad56-9830-4c7d-9763-6d8a05e0998c in Status: IN_PROGRESS for 2s [ 1030.622958] env[65306]: INFO networking_nsxv3.common.synchronization [req-bf64f492-a641-49bb-ba69-bbcace4eef34 req-2c8658f3-b4c2-4ba7-acde-728947328fd5 service nova] Enqueued Resource ID: 7f22d913-90d3-4ccb-8780-b9dbc479a7d3 with Priority: HIGHEST for action security_group_rules [ 1030.622958] env[65306]: INFO networking_nsxv3.common.synchronization [req-bf64f492-a641-49bb-ba69-bbcace4eef34 req-2c8658f3-b4c2-4ba7-acde-728947328fd5 service nova] Enqueued Resource ID: 7f22d913-90d3-4ccb-8780-b9dbc479a7d3 with Priority: HIGHEST for action security_group_members [ 1030.622958] env[65306]: INFO networking_nsxv3.common.synchronization [req-bf64f492-a641-49bb-ba69-bbcace4eef34 req-2c8658f3-b4c2-4ba7-acde-728947328fd5 service nova] Enqueued Resource ID: b0dc9a2a-f5aa-4df0-9754-4b8b78204191 with Priority: HIGHEST for action port [ 1030.626382] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7f22d913-90d3-4ccb-8780-b9dbc479a7d3 with Priority: HIGHEST for action security_group_rules [ 1030.626438] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7f22d913-90d3-4ccb-8780-b9dbc479a7d3 with Priority: HIGHEST for action security_group_members [ 1030.626562] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b0dc9a2a-f5aa-4df0-9754-4b8b78204191 with Priority: HIGHEST for action port [ 1030.627359] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7f22d913-90d3-4ccb-8780-b9dbc479a7d3 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.629178] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7f22d913-90d3-4ccb-8780-b9dbc479a7d3" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.629178] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7f22d913-90d3-4ccb-8780-b9dbc479a7d3" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.629178] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7f22d913-90d3-4ccb-8780-b9dbc479a7d3" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.629178] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7f22d913-90d3-4ccb-8780-b9dbc479a7d3',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1030.629178] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-7f22d913-90d3-4ccb-8780-b9dbc479a7d3 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.629505] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7f22d913-90d3-4ccb-8780-b9dbc479a7d3" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.629505] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7f22d913-90d3-4ccb-8780-b9dbc479a7d3" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.629593] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7f22d913-90d3-4ccb-8780-b9dbc479a7d3" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.629748] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.629869] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.629937] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.634281] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.634403] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.634516] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7f22d913-90d3-4ccb-8780-b9dbc479a7d3',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1030.636878] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock port-b0dc9a2a-f5aa-4df0-9754-4b8b78204191 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.636878] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b0dc9a2a-f5aa-4df0-9754-4b8b78204191" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.636878] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b0dc9a2a-f5aa-4df0-9754-4b8b78204191" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.636878] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b0dc9a2a-f5aa-4df0-9754-4b8b78204191" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.636878] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b0dc9a2a-f5aa-4df0-9754-4b8b78204191',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1031.137539] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-7f22d913-90d3-4ccb-8780-b9dbc479a7d3 taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.138362] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7f22d913-90d3-4ccb-8780-b9dbc479a7d3" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.139977] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7f22d913-90d3-4ccb-8780-b9dbc479a7d3',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1031.141043] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b0dc9a2a-f5aa-4df0-9754-4b8b78204191 with status ACTIVE [ 1031.141276] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.142368] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.142463] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.142666] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.142754] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.142989] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.143690] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.143780] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.143965] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.144059] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.144334] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.144399] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.144461] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.144600] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.144672] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.144759] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b0dc9a2a-f5aa-4df0-9754-4b8b78204191 is going to be updated. [ 1031.169479] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.169826] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.169936] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.170257] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.170799] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.170799] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b0dc9a2a-f5aa-4df0-9754-4b8b78204191" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.647586] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7f22d913-90d3-4ccb-8780-b9dbc479a7d3',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1032.149794] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.150234] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.150234] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.150331] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.150429] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.150538] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7f22d913-90d3-4ccb-8780-b9dbc479a7d3 is going to be created. [ 1032.176264] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.176474] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.176474] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.176737] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.176923] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.186747] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7f22d913-90d3-4ccb-8780-b9dbc479a7d3 in Status: UNINITIALIZED for 2s [ 1032.375123] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d82bad56-9830-4c7d-9763-6d8a05e0998c in Status: SUCCESS [ 1032.375375] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d82bad56-9830-4c7d-9763-6d8a05e0998c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.375552] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d82bad56-9830-4c7d-9763-6d8a05e0998c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.375771] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d82bad56-9830-4c7d-9763-6d8a05e0998c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.375968] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.376094] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.376156] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.376312] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.376394] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.376481] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d82bad56-9830-4c7d-9763-6d8a05e0998c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.376576] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d82bad56-9830-4c7d-9763-6d8a05e0998c',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1032.878972] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-d82bad56-9830-4c7d-9763-6d8a05e0998c taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.879241] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d82bad56-9830-4c7d-9763-6d8a05e0998c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.879241] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d82bad56-9830-4c7d-9763-6d8a05e0998c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.879377] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d82bad56-9830-4c7d-9763-6d8a05e0998c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.879584] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.879701] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.879785] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.879970] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.880094] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.880202] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d82bad56-9830-4c7d-9763-6d8a05e0998c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.880360] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-d82bad56-9830-4c7d-9763-6d8a05e0998c taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.880465] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d82bad56-9830-4c7d-9763-6d8a05e0998c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.880536] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d82bad56-9830-4c7d-9763-6d8a05e0998c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.880703] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d82bad56-9830-4c7d-9763-6d8a05e0998c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.880933] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.881021] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.881021] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.881278] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.881434] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.881532] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d82bad56-9830-4c7d-9763-6d8a05e0998c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.881632] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d82bad56-9830-4c7d-9763-6d8a05e0998c',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1033.383558] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d82bad56-9830-4c7d-9763-6d8a05e0998c: rpc.has_security_group_logging(os_id): False [ 1033.403783] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.403981] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.404110] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.404346] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.404428] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.404709] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.404845] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.404933] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.405273] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.405377] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.405651] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.405793] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.405866] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.406060] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.406254] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.406437] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.406512] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.406564] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.406708] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.406810] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.406936] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d82bad56-9830-4c7d-9763-6d8a05e0998c is going to be updated. [ 1033.473431] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.473653] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.473843] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.474128] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.474336] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.494183] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d82bad56-9830-4c7d-9763-6d8a05e0998c in Status: IN_PROGRESS for 2s [ 1033.824960] env[65306]: INFO networking_nsxv3.common.synchronization [req-ed21efac-0b70-45ae-89dc-430a18dd169f req-fdd2b564-2c8a-4868-be2f-66ce1e4661f4 tempest-ServersAdminTestJSON-2076938379 tempest-ServersAdminTestJSON-2076938379-project-member] Enqueued Resource ID: 56904b3c-38e4-4547-9a1d-cc787c3fef9d with Priority: HIGHEST for action security_group_members [ 1033.825541] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 56904b3c-38e4-4547-9a1d-cc787c3fef9d with Priority: HIGHEST for action security_group_members [ 1033.825852] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-56904b3c-38e4-4547-9a1d-cc787c3fef9d taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.826193] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-56904b3c-38e4-4547-9a1d-cc787c3fef9d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.826193] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-56904b3c-38e4-4547-9a1d-cc787c3fef9d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.826358] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-56904b3c-38e4-4547-9a1d-cc787c3fef9d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.826432] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.826488] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.826524] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.826667] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.826757] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.826855] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('56904b3c-38e4-4547-9a1d-cc787c3fef9d',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1034.203049] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7f22d913-90d3-4ccb-8780-b9dbc479a7d3 in Status: SUCCESS [ 1034.203213] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7f22d913-90d3-4ccb-8780-b9dbc479a7d3" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.203379] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7f22d913-90d3-4ccb-8780-b9dbc479a7d3" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.203737] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7f22d913-90d3-4ccb-8780-b9dbc479a7d3" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.203948] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.204286] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.204477] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.204784] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.204943] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.205123] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7f22d913-90d3-4ccb-8780-b9dbc479a7d3" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.205314] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7f22d913-90d3-4ccb-8780-b9dbc479a7d3',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1034.329283] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('56904b3c-38e4-4547-9a1d-cc787c3fef9d',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1034.707975] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7f22d913-90d3-4ccb-8780-b9dbc479a7d3',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1034.832898] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('56904b3c-38e4-4547-9a1d-cc787c3fef9d',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1035.210739] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7f22d913-90d3-4ccb-8780-b9dbc479a7d3: rpc.has_security_group_logging(os_id): False [ 1035.232379] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.233045] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.233045] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.233184] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.233224] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.233472] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.233587] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.233919] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.233919] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.233919] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.234090] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7f22d913-90d3-4ccb-8780-b9dbc479a7d3 is going to be created. [ 1035.301017] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.301256] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.301256] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.301462] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.301646] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.314563] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7f22d913-90d3-4ccb-8780-b9dbc479a7d3 in Status: IN_PROGRESS for 2s [ 1035.335280] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.335550] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.335640] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.335848] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.335952] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.336058] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 56904b3c-38e4-4547-9a1d-cc787c3fef9d is going to be updated. [ 1035.422789] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.423050] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.423126] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.423429] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.423667] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.436839] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 56904b3c-38e4-4547-9a1d-cc787c3fef9d in Status: IN_PROGRESS for 2s [ 1035.513558] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d82bad56-9830-4c7d-9763-6d8a05e0998c in Status: SUCCESS [ 1035.513787] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d82bad56-9830-4c7d-9763-6d8a05e0998c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.330111] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7f22d913-90d3-4ccb-8780-b9dbc479a7d3 in Status: SUCCESS [ 1037.330111] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7f22d913-90d3-4ccb-8780-b9dbc479a7d3" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.449766] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 56904b3c-38e4-4547-9a1d-cc787c3fef9d in Status: SUCCESS [ 1037.451272] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-56904b3c-38e4-4547-9a1d-cc787c3fef9d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.005588] env[65306]: INFO networking_nsxv3.common.synchronization [req-891dd82c-7632-44f0-bc7d-abff59a819b7 req-198b048d-502d-4f78-b6f4-b72a2a4a701f tempest-ServerDiskConfigTestJSON-771154958 tempest-ServerDiskConfigTestJSON-771154958-project-member] Enqueued Resource ID: 9e80329d-1fcd-4c50-8991-a90e2a1fbdbc with Priority: HIGHEST for action security_group_members [ 1038.006809] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9e80329d-1fcd-4c50-8991-a90e2a1fbdbc with Priority: HIGHEST for action security_group_members [ 1038.006809] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-9e80329d-1fcd-4c50-8991-a90e2a1fbdbc taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.006809] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9e80329d-1fcd-4c50-8991-a90e2a1fbdbc" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.006809] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9e80329d-1fcd-4c50-8991-a90e2a1fbdbc" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.006809] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9e80329d-1fcd-4c50-8991-a90e2a1fbdbc" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.007112] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.007112] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.007848] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.007848] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.007848] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.007848] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9e80329d-1fcd-4c50-8991-a90e2a1fbdbc',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1038.496914] env[65306]: INFO networking_nsxv3.common.synchronization [req-6716cc30-86d8-4dce-926d-70584f139bf2 req-a15c70bc-ba93-47b6-9def-ff397b7485b5 tempest-ImagesTestJSON-762064805 tempest-ImagesTestJSON-762064805-project-member] Enqueued Resource ID: 57bb6fe9-98c4-47f0-9daa-c424a0c9dfee with Priority: HIGHEST for action security_group_members [ 1038.497519] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 57bb6fe9-98c4-47f0-9daa-c424a0c9dfee with Priority: HIGHEST for action security_group_members [ 1038.497835] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-57bb6fe9-98c4-47f0-9daa-c424a0c9dfee taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.497960] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-57bb6fe9-98c4-47f0-9daa-c424a0c9dfee" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.501267] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-57bb6fe9-98c4-47f0-9daa-c424a0c9dfee" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.501528] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-57bb6fe9-98c4-47f0-9daa-c424a0c9dfee" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.501720] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.501826] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.501893] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.502099] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.502213] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.502315] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('57bb6fe9-98c4-47f0-9daa-c424a0c9dfee',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1038.510936] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.511214] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.511214] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.511537] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.511619] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.511840] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.511939] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.512439] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.512439] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.512439] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.512439] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9e80329d-1fcd-4c50-8991-a90e2a1fbdbc is going to be updated. [ 1038.546771] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.547092] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.547223] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.547606] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.547814] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.562515] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9e80329d-1fcd-4c50-8991-a90e2a1fbdbc in Status: IN_PROGRESS for 2s [ 1038.845253] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock network-681 taken with stack trace [, , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.845523] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "network-681" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.845616] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "network-681" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.845932] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "network-681" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.846690] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.846690] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.846891] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.847233] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.847233] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.847380] env[65306]: DEBUG dogpile.cache.region [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] No value present for key: 'zone-id' {{(pid=65306) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1038.847489] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] NeedRegenerationException {{(pid=65306) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1038.847687] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] no value, waiting for create lock {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1038.847687] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] value creation lock acquired {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1038.847819] env[65306]: DEBUG dogpile.cache.region [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] No value present for key: 'zone-id' {{(pid=65306) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1038.847989] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Calling creation function for not-yet-present value {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1038.848095] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1038.868691] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1038.868818] env[65306]: DEBUG dogpile.cache.region [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65306) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1038.869131] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Released creation lock {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1038.869131] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "network-681" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.869460] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock port-97762736-896f-4a3b-bb9e-cc57d1cbd31b taken with stack trace [, , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.869588] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "port-97762736-896f-4a3b-bb9e-cc57d1cbd31b" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.869693] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "port-97762736-896f-4a3b-bb9e-cc57d1cbd31b" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.870067] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "port-97762736-896f-4a3b-bb9e-cc57d1cbd31b" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.870418] env[65306]: DEBUG networking_nsxv3.api.rpc [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('97762736-896f-4a3b-bb9e-cc57d1cbd31b',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1039.004855] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.005155] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.005155] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.005337] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.005410] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.005817] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.005890] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.006059] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.006253] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.006335] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.006447] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 57bb6fe9-98c4-47f0-9daa-c424a0c9dfee is going to be updated. [ 1039.039353] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.039518] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.039590] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.039821] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.039987] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.050672] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 57bb6fe9-98c4-47f0-9daa-c424a0c9dfee in Status: IN_PROGRESS for 2s [ 1039.377020] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.377020] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.377020] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.377020] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.377020] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.377020] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Segment Port 97762736-896f-4a3b-bb9e-cc57d1cbd31b not found, creating... [ 1039.377020] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.377020] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.377020] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.377020] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.377020] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.377652] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.377652] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.377652] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.377652] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.378057] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.378243] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Resource: SegmentPort with ID: 97762736-896f-4a3b-bb9e-cc57d1cbd31b is going to be created. [ 1039.401422] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.401678] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.402328] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.402328] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.402521] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.402654] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "port-97762736-896f-4a3b-bb9e-cc57d1cbd31b" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.072177] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.072523] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.072523] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.072846] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.073023] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1040.146484] env[65306]: INFO networking_nsxv3.common.synchronization [req-891dd82c-7632-44f0-bc7d-abff59a819b7 req-f1857a3a-0e9a-4182-806e-ca7802200534 service nova] Enqueued Resource ID: 9e80329d-1fcd-4c50-8991-a90e2a1fbdbc with Priority: HIGHEST for action security_group_rules [ 1040.152545] env[65306]: INFO networking_nsxv3.common.synchronization [req-891dd82c-7632-44f0-bc7d-abff59a819b7 req-f1857a3a-0e9a-4182-806e-ca7802200534 service nova] Enqueued Resource ID: 9e80329d-1fcd-4c50-8991-a90e2a1fbdbc with Priority: HIGHEST for action security_group_members [ 1040.152545] env[65306]: INFO networking_nsxv3.common.synchronization [req-891dd82c-7632-44f0-bc7d-abff59a819b7 req-f1857a3a-0e9a-4182-806e-ca7802200534 service nova] Enqueued Resource ID: 97762736-896f-4a3b-bb9e-cc57d1cbd31b with Priority: HIGHEST for action port [ 1040.152545] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9e80329d-1fcd-4c50-8991-a90e2a1fbdbc with Priority: HIGHEST for action security_group_rules [ 1040.152545] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9e80329d-1fcd-4c50-8991-a90e2a1fbdbc with Priority: HIGHEST for action security_group_members [ 1040.152545] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 97762736-896f-4a3b-bb9e-cc57d1cbd31b with Priority: HIGHEST for action port [ 1040.152545] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9e80329d-1fcd-4c50-8991-a90e2a1fbdbc taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.152545] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9e80329d-1fcd-4c50-8991-a90e2a1fbdbc" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.152545] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9e80329d-1fcd-4c50-8991-a90e2a1fbdbc" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.152545] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9e80329d-1fcd-4c50-8991-a90e2a1fbdbc" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.152545] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9e80329d-1fcd-4c50-8991-a90e2a1fbdbc',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1040.152545] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-9e80329d-1fcd-4c50-8991-a90e2a1fbdbc taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.152545] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9e80329d-1fcd-4c50-8991-a90e2a1fbdbc" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.152545] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock port-97762736-896f-4a3b-bb9e-cc57d1cbd31b taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.152545] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-97762736-896f-4a3b-bb9e-cc57d1cbd31b" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.152545] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-97762736-896f-4a3b-bb9e-cc57d1cbd31b" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.153148] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-97762736-896f-4a3b-bb9e-cc57d1cbd31b" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.153148] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('97762736-896f-4a3b-bb9e-cc57d1cbd31b',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1040.575977] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1040.578317] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9e80329d-1fcd-4c50-8991-a90e2a1fbdbc in Status: SUCCESS [ 1040.578483] env[65306]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9e80329d-1fcd-4c50-8991-a90e2a1fbdbc deletion is rescheduled due to dependency. [ 1040.578573] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9e80329d-1fcd-4c50-8991-a90e2a1fbdbc" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.578705] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9e80329d-1fcd-4c50-8991-a90e2a1fbdbc" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.579078] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9e80329d-1fcd-4c50-8991-a90e2a1fbdbc" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.579290] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.579416] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.579489] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.579692] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.579783] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.579928] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9e80329d-1fcd-4c50-8991-a90e2a1fbdbc',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1040.654865] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-9e80329d-1fcd-4c50-8991-a90e2a1fbdbc taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.655100] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9e80329d-1fcd-4c50-8991-a90e2a1fbdbc" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.660264] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 97762736-896f-4a3b-bb9e-cc57d1cbd31b with status ACTIVE [ 1040.660576] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.661143] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.661143] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.661143] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.661411] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.661411] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.661566] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.661630] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.661941] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.661941] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.662207] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.662291] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.662408] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.662918] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.662918] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.662918] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 97762736-896f-4a3b-bb9e-cc57d1cbd31b is going to be updated. [ 1040.685454] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.686033] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.686033] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.686033] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.686033] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.686238] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-97762736-896f-4a3b-bb9e-cc57d1cbd31b" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.071110] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 57bb6fe9-98c4-47f0-9daa-c424a0c9dfee in Status: SUCCESS [ 1041.071336] env[65306]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 57bb6fe9-98c4-47f0-9daa-c424a0c9dfee deletion is rescheduled due to dependency. [ 1041.071470] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-57bb6fe9-98c4-47f0-9daa-c424a0c9dfee" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.082056] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1041.083181] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9e80329d-1fcd-4c50-8991-a90e2a1fbdbc',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1041.535185] env[65306]: INFO networking_nsxv3.common.synchronization [req-0c7e5371-f375-47bc-8b6d-3ce12a69c298 req-00db04a4-3fa1-4d33-ac4f-999aa2621a8c tempest-AttachInterfacesTestJSON-144464476 tempest-AttachInterfacesTestJSON-144464476-project-member] Enqueued Resource ID: 60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d with Priority: HIGHEST for action security_group_members [ 1041.535512] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d with Priority: HIGHEST for action security_group_members [ 1041.535805] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.535953] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.535995] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.536268] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.536429] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.536533] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.536594] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.536745] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.536858] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.536951] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1041.585038] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 1041.585038] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 1041.586077] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9e80329d-1fcd-4c50-8991-a90e2a1fbdbc',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1041.827268] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock network-540 taken with stack trace [, , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.827514] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "network-540" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.827650] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "network-540" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.827957] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "network-540" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.828278] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.828525] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.828748] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.829013] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.829237] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.829485] env[65306]: DEBUG dogpile.cache.region [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] No value present for key: 'zone-id' {{(pid=65306) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1041.829596] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] NeedRegenerationException {{(pid=65306) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1041.829721] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] no value, waiting for create lock {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1041.829845] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] value creation lock acquired {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1041.830013] env[65306]: DEBUG dogpile.cache.region [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] No value present for key: 'zone-id' {{(pid=65306) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1041.830261] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Calling creation function for not-yet-present value {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1041.830442] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1041.850426] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1041.850670] env[65306]: DEBUG dogpile.cache.region [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65306) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1041.850782] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Released creation lock {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1041.850905] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "network-540" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.851317] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock port-120ddd47-5f41-46c6-93e8-19aafaa8bc03 taken with stack trace [, , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.851530] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "port-120ddd47-5f41-46c6-93e8-19aafaa8bc03" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.851660] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "port-120ddd47-5f41-46c6-93e8-19aafaa8bc03" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.851981] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "port-120ddd47-5f41-46c6-93e8-19aafaa8bc03" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.852163] env[65306]: DEBUG networking_nsxv3.api.rpc [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('120ddd47-5f41-46c6-93e8-19aafaa8bc03',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1042.040292] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.040591] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.040734] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.041425] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.041425] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.041689] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.041801] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.041801] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.041973] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.042076] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.042366] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d already deleted. [ 1042.042475] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.089433] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.089924] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.089924] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.089924] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.090117] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.090177] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9e80329d-1fcd-4c50-8991-a90e2a1fbdbc is going to be updated. [ 1042.124476] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.124699] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.124699] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.124877] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.125034] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.135233] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9e80329d-1fcd-4c50-8991-a90e2a1fbdbc in Status: IN_PROGRESS for 2s [ 1042.354514] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.354773] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.354901] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.355204] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.355360] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.355514] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Segment Port 120ddd47-5f41-46c6-93e8-19aafaa8bc03 not found, creating... [ 1042.355770] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.355922] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.356047] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.356261] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.356395] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.356663] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.356869] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.356975] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.357561] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.357561] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.357680] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Resource: SegmentPort with ID: 120ddd47-5f41-46c6-93e8-19aafaa8bc03 is going to be created. [ 1042.383549] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.383889] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.384082] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.384466] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.384872] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.385170] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "port-120ddd47-5f41-46c6-93e8-19aafaa8bc03" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.650327] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.650483] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.650756] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.650756] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.665072] env[65306]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 1042.666051] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.667147] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 1042.708755] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.709560] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.709560] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.709560] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.722683] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.723598] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 1042.723699] env[65306]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=65306) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1042.723798] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 1042.773550] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.773780] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.773780] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.774016] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.775945] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.776220] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 1042.857020] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.857020] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.857020] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.858038] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.858730] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.858814] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 1042.942365] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.949035] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.949035] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.949035] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.949035] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.949035] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:46. [ 1042.949035] env[65306]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'18bb45c8-7cab-44a5-887c-82deb65b8e26', '99194846-a5d9-4dff-8a78-5c66da2ee811', '57bb6fe9-98c4-47f0-9daa-c424a0c9dfee', 'd7a326c8-f35c-48c1-831b-ebd2cbb656e7', '563b7655-db8f-408d-8ce8-bfec6b58c669', '9e80329d-1fcd-4c50-8991-a90e2a1fbdbc', 'aceee07e-3675-474c-96e8-9fe510f1356f', '3bb1834c-39ac-4ba9-bce1-44f7a4805a24', 'c90bbe47-7f68-400a-a228-2030ba9cad31', '331be455-1cf8-4667-8d43-bd7a51712610', '0cb41b0f-cdd2-4222-95b4-bafd614b7460', '8beaaac6-ba63-44e8-a960-7e228e2e7d37', '7f0c403f-7209-472e-8592-d169f66791c9', '50a889c1-6336-4320-94ea-df1e6eaa778c', 'ef5de9e7-0c3b-4386-af3c-de134eff75f3', '0defdd0d-cdbe-4a7c-9871-fd4c40a3847e', 'ca47d813-3b19-4aa2-8339-4f933a85963f', 'c9bd98cc-e392-44de-a51c-e4fc7d37da1f', '979b0e99-7f65-434d-a9e9-1ff018f5b499', '37349b8b-c2c1-4141-8b10-752c27492cbd', 'e21f899c-0473-418d-9b8f-8591e9dc160f', '7c868cfd-e55d-4976-95db-5b3f64c76a5f', '3eee5457-701b-405e-bdf2-f055e0150d49', 'b9d469db-f694-4408-9c06-70ff03328f59', '7f22d913-90d3-4ccb-8780-b9dbc479a7d3', '56904b3c-38e4-4547-9a1d-cc787c3fef9d', 'dbcb04c7-d4cb-4ab9-8312-c80dffeeaa42', '830915ca-b7ed-480d-8dcc-06210706a96a', '55a6ae08-0730-4d04-bc2c-3f0c36758315', 'd82bad56-9830-4c7d-9763-6d8a05e0998c', 'c3ffb1bc-84c3-4121-a677-8d413e70c9cc', '7b301620-e19b-4a95-9103-ce7982b7fa1d', 'a7dafaf4-f702-4dc9-bc77-265f5268966a', '23ae6942-da1d-46a7-951e-aa32b51f50d2', '5188a191-fc4a-4216-b94f-2b854c8abd88', '5ec09b70-aa5a-48ff-b72f-a5c6c81190e0', '30524546-2ed3-474c-bf2b-fc6aff50dfec', '4ccf00ad-53bf-45d0-a342-260b14c2ccf2', '5c095c1f-60f5-47d0-b270-e33f847ba33b', 'f5174f7c-dc12-4dad-9284-eed34d64b830', 'e3e0f6b2-2984-4938-adcc-0374a714ff76', 'c3a4b03d-2231-4b42-a522-be404c2784e5', '4e234e08-a192-4c7a-badf-3e57629854d7', '2cdaf88a-80a7-4019-9156-d7e0483af77f', 'a3364d7c-b2fd-4f01-932a-1feef0fa76de', '6e403189-fcac-40e3-aa50-4c17f4d29895'} {{(pid=65306) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1042.949035] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 1042.972134] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.972870] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.973748] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.973748] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.973748] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.973748] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 1042.974184] env[65306]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=65306) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1042.974407] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 1043.067687] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.067897] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.067994] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.068225] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.069804] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.070342] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 1043.070342] env[65306]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=65306) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1043.070342] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 1043.070477] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 1043.070477] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 20/46 resources of Type:Security Group Rules [ 1043.070631] env[65306]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 18bb45c8-7cab-44a5-887c-82deb65b8e26 with Priority: HIGH for action security_group_rules [ 1043.070706] env[65306]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 99194846-a5d9-4dff-8a78-5c66da2ee811 with Priority: HIGH for action security_group_rules [ 1043.070761] env[65306]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 57bb6fe9-98c4-47f0-9daa-c424a0c9dfee with Priority: HIGH for action security_group_rules [ 1043.070817] env[65306]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: d7a326c8-f35c-48c1-831b-ebd2cbb656e7 with Priority: HIGH for action security_group_rules [ 1043.070868] env[65306]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 563b7655-db8f-408d-8ce8-bfec6b58c669 with Priority: HIGH for action security_group_rules [ 1043.071389] env[65306]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 9e80329d-1fcd-4c50-8991-a90e2a1fbdbc with Priority: HIGH for action security_group_rules [ 1043.071389] env[65306]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: aceee07e-3675-474c-96e8-9fe510f1356f with Priority: HIGH for action security_group_rules [ 1043.071389] env[65306]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 3bb1834c-39ac-4ba9-bce1-44f7a4805a24 with Priority: HIGH for action security_group_rules [ 1043.071389] env[65306]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: c90bbe47-7f68-400a-a228-2030ba9cad31 with Priority: HIGH for action security_group_rules [ 1043.071389] env[65306]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 331be455-1cf8-4667-8d43-bd7a51712610 with Priority: HIGH for action security_group_rules [ 1043.071389] env[65306]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 0cb41b0f-cdd2-4222-95b4-bafd614b7460 with Priority: HIGH for action security_group_rules [ 1043.071389] env[65306]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 8beaaac6-ba63-44e8-a960-7e228e2e7d37 with Priority: HIGH for action security_group_rules [ 1043.071389] env[65306]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 7f0c403f-7209-472e-8592-d169f66791c9 with Priority: HIGH for action security_group_rules [ 1043.071389] env[65306]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 50a889c1-6336-4320-94ea-df1e6eaa778c with Priority: HIGH for action security_group_rules [ 1043.071991] env[65306]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: ef5de9e7-0c3b-4386-af3c-de134eff75f3 with Priority: HIGH for action security_group_rules [ 1043.071991] env[65306]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 0defdd0d-cdbe-4a7c-9871-fd4c40a3847e with Priority: HIGH for action security_group_rules [ 1043.071991] env[65306]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: ca47d813-3b19-4aa2-8339-4f933a85963f with Priority: HIGH for action security_group_rules [ 1043.071991] env[65306]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: c9bd98cc-e392-44de-a51c-e4fc7d37da1f with Priority: HIGH for action security_group_rules [ 1043.071991] env[65306]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 979b0e99-7f65-434d-a9e9-1ff018f5b499 with Priority: HIGH for action security_group_rules [ 1043.071991] env[65306]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 37349b8b-c2c1-4141-8b10-752c27492cbd with Priority: HIGH for action security_group_rules [ 1043.071991] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.112925] env[65306]: INFO networking_nsxv3.common.synchronization [req-0c7e5371-f375-47bc-8b6d-3ce12a69c298 req-1d42438a-eb04-46d5-80d6-7c6fbd3c36b7 service nova] Enqueued Resource ID: 60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d with Priority: HIGHEST for action security_group_rules [ 1043.113234] env[65306]: INFO networking_nsxv3.common.synchronization [req-0c7e5371-f375-47bc-8b6d-3ce12a69c298 req-1d42438a-eb04-46d5-80d6-7c6fbd3c36b7 service nova] Enqueued Resource ID: 60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d with Priority: HIGHEST for action security_group_members [ 1043.113371] env[65306]: INFO networking_nsxv3.common.synchronization [req-0c7e5371-f375-47bc-8b6d-3ce12a69c298 req-1d42438a-eb04-46d5-80d6-7c6fbd3c36b7 service nova] Enqueued Resource ID: 120ddd47-5f41-46c6-93e8-19aafaa8bc03 with Priority: HIGHEST for action port [ 1043.117214] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d with Priority: HIGHEST for action security_group_rules [ 1043.117214] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d with Priority: HIGHEST for action security_group_members [ 1043.117214] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 120ddd47-5f41-46c6-93e8-19aafaa8bc03 with Priority: HIGHEST for action port [ 1043.117214] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 18bb45c8-7cab-44a5-887c-82deb65b8e26 with Priority: HIGH for action security_group_rules [ 1043.117214] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 57bb6fe9-98c4-47f0-9daa-c424a0c9dfee with Priority: HIGH for action security_group_rules [ 1043.117214] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aceee07e-3675-474c-96e8-9fe510f1356f with Priority: HIGH for action security_group_rules [ 1043.117214] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ef5de9e7-0c3b-4386-af3c-de134eff75f3 with Priority: HIGH for action security_group_rules [ 1043.117214] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 37349b8b-c2c1-4141-8b10-752c27492cbd with Priority: HIGH for action security_group_rules [ 1043.117214] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 979b0e99-7f65-434d-a9e9-1ff018f5b499 with Priority: HIGH for action security_group_rules [ 1043.117214] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c9bd98cc-e392-44de-a51c-e4fc7d37da1f with Priority: HIGH for action security_group_rules [ 1043.117214] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ca47d813-3b19-4aa2-8339-4f933a85963f with Priority: HIGH for action security_group_rules [ 1043.117214] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 50a889c1-6336-4320-94ea-df1e6eaa778c with Priority: HIGH for action security_group_rules [ 1043.117214] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0defdd0d-cdbe-4a7c-9871-fd4c40a3847e with Priority: HIGH for action security_group_rules [ 1043.117214] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7f0c403f-7209-472e-8592-d169f66791c9 with Priority: HIGH for action security_group_rules [ 1043.117214] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8beaaac6-ba63-44e8-a960-7e228e2e7d37 with Priority: HIGH for action security_group_rules [ 1043.117214] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0cb41b0f-cdd2-4222-95b4-bafd614b7460 with Priority: HIGH for action security_group_rules [ 1043.117214] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 331be455-1cf8-4667-8d43-bd7a51712610 with Priority: HIGH for action security_group_rules [ 1043.117214] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c90bbe47-7f68-400a-a228-2030ba9cad31 with Priority: HIGH for action security_group_rules [ 1043.117214] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9e80329d-1fcd-4c50-8991-a90e2a1fbdbc with Priority: HIGH for action security_group_rules [ 1043.117214] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3bb1834c-39ac-4ba9-bce1-44f7a4805a24 with Priority: HIGH for action security_group_rules [ 1043.117214] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 563b7655-db8f-408d-8ce8-bfec6b58c669 with Priority: HIGH for action security_group_rules [ 1043.117214] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 99194846-a5d9-4dff-8a78-5c66da2ee811 with Priority: HIGH for action security_group_rules [ 1043.117214] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d7a326c8-f35c-48c1-831b-ebd2cbb656e7 with Priority: HIGH for action security_group_rules [ 1043.117214] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock rules-60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.117214] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.117214] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.118278] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.118278] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1043.119104] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.119288] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.119331] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.119511] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.119672] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.119766] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.119822] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.120027] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.120118] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.120227] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1043.124311] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock port-120ddd47-5f41-46c6-93e8-19aafaa8bc03 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.124509] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-120ddd47-5f41-46c6-93e8-19aafaa8bc03" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.124509] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-120ddd47-5f41-46c6-93e8-19aafaa8bc03" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.124710] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-120ddd47-5f41-46c6-93e8-19aafaa8bc03" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.124767] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('120ddd47-5f41-46c6-93e8-19aafaa8bc03',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1043.125684] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock rules-18bb45c8-7cab-44a5-887c-82deb65b8e26 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.125788] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-18bb45c8-7cab-44a5-887c-82deb65b8e26" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.125892] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-18bb45c8-7cab-44a5-887c-82deb65b8e26" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.126063] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-18bb45c8-7cab-44a5-887c-82deb65b8e26" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.126171] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('18bb45c8-7cab-44a5-887c-82deb65b8e26',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1043.129696] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock rules-57bb6fe9-98c4-47f0-9daa-c424a0c9dfee taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.129818] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-57bb6fe9-98c4-47f0-9daa-c424a0c9dfee" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.129818] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-57bb6fe9-98c4-47f0-9daa-c424a0c9dfee" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.130107] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-57bb6fe9-98c4-47f0-9daa-c424a0c9dfee" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.131052] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('57bb6fe9-98c4-47f0-9daa-c424a0c9dfee',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1043.131290] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock rules-aceee07e-3675-474c-96e8-9fe510f1356f taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.131398] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-aceee07e-3675-474c-96e8-9fe510f1356f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.131483] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-aceee07e-3675-474c-96e8-9fe510f1356f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.131861] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-aceee07e-3675-474c-96e8-9fe510f1356f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.132243] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('aceee07e-3675-474c-96e8-9fe510f1356f',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1043.133217] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ef5de9e7-0c3b-4386-af3c-de134eff75f3 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.133840] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ef5de9e7-0c3b-4386-af3c-de134eff75f3" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.133840] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ef5de9e7-0c3b-4386-af3c-de134eff75f3" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.133840] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ef5de9e7-0c3b-4386-af3c-de134eff75f3" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.133840] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ef5de9e7-0c3b-4386-af3c-de134eff75f3',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1043.135051] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock rules-37349b8b-c2c1-4141-8b10-752c27492cbd taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.135176] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-37349b8b-c2c1-4141-8b10-752c27492cbd" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.135250] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-37349b8b-c2c1-4141-8b10-752c27492cbd" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.135863] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-37349b8b-c2c1-4141-8b10-752c27492cbd" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.135863] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('37349b8b-c2c1-4141-8b10-752c27492cbd',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1043.137045] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock rules-979b0e99-7f65-434d-a9e9-1ff018f5b499 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.137613] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-979b0e99-7f65-434d-a9e9-1ff018f5b499" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.137613] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-979b0e99-7f65-434d-a9e9-1ff018f5b499" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.137613] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-979b0e99-7f65-434d-a9e9-1ff018f5b499" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.137613] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('979b0e99-7f65-434d-a9e9-1ff018f5b499',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1043.138514] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c9bd98cc-e392-44de-a51c-e4fc7d37da1f taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.138703] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c9bd98cc-e392-44de-a51c-e4fc7d37da1f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.138703] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c9bd98cc-e392-44de-a51c-e4fc7d37da1f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.138833] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c9bd98cc-e392-44de-a51c-e4fc7d37da1f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.138891] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c9bd98cc-e392-44de-a51c-e4fc7d37da1f',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1043.139636] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ca47d813-3b19-4aa2-8339-4f933a85963f taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.139745] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ca47d813-3b19-4aa2-8339-4f933a85963f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.139818] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ca47d813-3b19-4aa2-8339-4f933a85963f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.139965] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ca47d813-3b19-4aa2-8339-4f933a85963f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.140631] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ca47d813-3b19-4aa2-8339-4f933a85963f',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1043.141729] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock rules-50a889c1-6336-4320-94ea-df1e6eaa778c taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.141874] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-50a889c1-6336-4320-94ea-df1e6eaa778c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.141945] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-50a889c1-6336-4320-94ea-df1e6eaa778c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.142165] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-50a889c1-6336-4320-94ea-df1e6eaa778c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.142252] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('50a889c1-6336-4320-94ea-df1e6eaa778c',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1043.143969] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0defdd0d-cdbe-4a7c-9871-fd4c40a3847e taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.144146] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0defdd0d-cdbe-4a7c-9871-fd4c40a3847e" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.144903] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0defdd0d-cdbe-4a7c-9871-fd4c40a3847e" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.144903] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0defdd0d-cdbe-4a7c-9871-fd4c40a3847e" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.144903] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0defdd0d-cdbe-4a7c-9871-fd4c40a3847e',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1043.145771] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7f0c403f-7209-472e-8592-d169f66791c9 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.145913] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7f0c403f-7209-472e-8592-d169f66791c9" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.145997] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7f0c403f-7209-472e-8592-d169f66791c9" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.146149] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7f0c403f-7209-472e-8592-d169f66791c9" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.146246] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7f0c403f-7209-472e-8592-d169f66791c9',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1043.146958] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8beaaac6-ba63-44e8-a960-7e228e2e7d37 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.147108] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8beaaac6-ba63-44e8-a960-7e228e2e7d37" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.147175] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8beaaac6-ba63-44e8-a960-7e228e2e7d37" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.147295] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8beaaac6-ba63-44e8-a960-7e228e2e7d37" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.147369] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8beaaac6-ba63-44e8-a960-7e228e2e7d37',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1043.148230] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0cb41b0f-cdd2-4222-95b4-bafd614b7460 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.148380] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0cb41b0f-cdd2-4222-95b4-bafd614b7460" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.148433] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0cb41b0f-cdd2-4222-95b4-bafd614b7460" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.148585] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0cb41b0f-cdd2-4222-95b4-bafd614b7460" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.148663] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0cb41b0f-cdd2-4222-95b4-bafd614b7460',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1043.149537] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock rules-331be455-1cf8-4667-8d43-bd7a51712610 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.149667] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-331be455-1cf8-4667-8d43-bd7a51712610" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.149730] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-331be455-1cf8-4667-8d43-bd7a51712610" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.149901] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-331be455-1cf8-4667-8d43-bd7a51712610" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.149986] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('331be455-1cf8-4667-8d43-bd7a51712610',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1043.150732] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c90bbe47-7f68-400a-a228-2030ba9cad31 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.150878] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c90bbe47-7f68-400a-a228-2030ba9cad31" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.150929] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c90bbe47-7f68-400a-a228-2030ba9cad31" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.151076] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c90bbe47-7f68-400a-a228-2030ba9cad31" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.151165] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c90bbe47-7f68-400a-a228-2030ba9cad31',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1043.152897] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9e80329d-1fcd-4c50-8991-a90e2a1fbdbc taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.152897] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9e80329d-1fcd-4c50-8991-a90e2a1fbdbc" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.152897] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3bb1834c-39ac-4ba9-bce1-44f7a4805a24 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.152897] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3bb1834c-39ac-4ba9-bce1-44f7a4805a24" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.152897] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3bb1834c-39ac-4ba9-bce1-44f7a4805a24" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.152897] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3bb1834c-39ac-4ba9-bce1-44f7a4805a24" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.152897] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3bb1834c-39ac-4ba9-bce1-44f7a4805a24',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1043.153782] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock rules-563b7655-db8f-408d-8ce8-bfec6b58c669 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.153888] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-563b7655-db8f-408d-8ce8-bfec6b58c669" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.153972] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-563b7655-db8f-408d-8ce8-bfec6b58c669" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.154172] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-563b7655-db8f-408d-8ce8-bfec6b58c669" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.154256] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('563b7655-db8f-408d-8ce8-bfec6b58c669',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1043.155135] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock rules-99194846-a5d9-4dff-8a78-5c66da2ee811 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.155135] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-99194846-a5d9-4dff-8a78-5c66da2ee811" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.155404] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-99194846-a5d9-4dff-8a78-5c66da2ee811" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.155404] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-99194846-a5d9-4dff-8a78-5c66da2ee811" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.155899] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('99194846-a5d9-4dff-8a78-5c66da2ee811',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1043.156605] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d7a326c8-f35c-48c1-831b-ebd2cbb656e7 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.156736] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d7a326c8-f35c-48c1-831b-ebd2cbb656e7" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.156736] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d7a326c8-f35c-48c1-831b-ebd2cbb656e7" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.156946] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d7a326c8-f35c-48c1-831b-ebd2cbb656e7" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.156946] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d7a326c8-f35c-48c1-831b-ebd2cbb656e7',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1043.659396] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.659515] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.659778] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-50a889c1-6336-4320-94ea-df1e6eaa778c taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.659882] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-50a889c1-6336-4320-94ea-df1e6eaa778c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.659941] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-50a889c1-6336-4320-94ea-df1e6eaa778c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.660217] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-50a889c1-6336-4320-94ea-df1e6eaa778c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.660373] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.660473] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.660536] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.660695] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.660783] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.660867] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-50a889c1-6336-4320-94ea-df1e6eaa778c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.661690] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('50a889c1-6336-4320-94ea-df1e6eaa778c',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1043.661878] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1043.662705] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-331be455-1cf8-4667-8d43-bd7a51712610 taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.662810] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-331be455-1cf8-4667-8d43-bd7a51712610" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.662872] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-331be455-1cf8-4667-8d43-bd7a51712610" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.663045] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-331be455-1cf8-4667-8d43-bd7a51712610" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.663189] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.663278] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.663339] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.663484] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.663565] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.663659] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-331be455-1cf8-4667-8d43-bd7a51712610" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.663837] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('331be455-1cf8-4667-8d43-bd7a51712610',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1043.667929] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-979b0e99-7f65-434d-a9e9-1ff018f5b499 taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.667929] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-979b0e99-7f65-434d-a9e9-1ff018f5b499" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.668049] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-979b0e99-7f65-434d-a9e9-1ff018f5b499" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.668132] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-979b0e99-7f65-434d-a9e9-1ff018f5b499" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.668298] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.668371] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.668416] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.668570] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.668789] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.668854] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-979b0e99-7f65-434d-a9e9-1ff018f5b499" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.668924] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('979b0e99-7f65-434d-a9e9-1ff018f5b499',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1043.672523] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-0cb41b0f-cdd2-4222-95b4-bafd614b7460 taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.672523] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0cb41b0f-cdd2-4222-95b4-bafd614b7460" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.672523] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0cb41b0f-cdd2-4222-95b4-bafd614b7460" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.672711] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0cb41b0f-cdd2-4222-95b4-bafd614b7460" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.672931] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.672931] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.673046] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.673232] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.673232] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.673350] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0cb41b0f-cdd2-4222-95b4-bafd614b7460" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.674107] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0cb41b0f-cdd2-4222-95b4-bafd614b7460',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1043.679409] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-37349b8b-c2c1-4141-8b10-752c27492cbd taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.679548] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-37349b8b-c2c1-4141-8b10-752c27492cbd" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.679600] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-37349b8b-c2c1-4141-8b10-752c27492cbd" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.680457] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-37349b8b-c2c1-4141-8b10-752c27492cbd" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.680457] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.680457] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.680457] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.680457] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.680457] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.680457] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-37349b8b-c2c1-4141-8b10-752c27492cbd" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.680867] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('37349b8b-c2c1-4141-8b10-752c27492cbd',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1043.685565] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 120ddd47-5f41-46c6-93e8-19aafaa8bc03 with status ACTIVE [ 1043.685869] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.686045] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.686151] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.686428] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.686585] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.686803] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.686918] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.687055] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.687257] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.687339] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.687558] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.687659] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.687724] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.688445] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.688445] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.688445] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 120ddd47-5f41-46c6-93e8-19aafaa8bc03 is going to be updated. [ 1043.742661] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.742661] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.742661] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.743487] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.754325] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.754539] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.755380] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.755548] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.756325] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.756423] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.757909] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.758030] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.761310] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.761412] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.762220] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.762328] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.767375] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.767486] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.768297] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.768396] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.769105] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.769200] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.769896] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.769990] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.771962] env[65306]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1043.772464] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.772644] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0defdd0d-cdbe-4a7c-9871-fd4c40a3847e is going to be deleted. [ 1043.773976] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.774231] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.777469] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.777573] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.777645] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.777849] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.777987] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.778232] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-120ddd47-5f41-46c6-93e8-19aafaa8bc03" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.779173] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.779317] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.779981] env[65306]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1043.780468] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.780577] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.781361] env[65306]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1043.782107] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.782231] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.800547] env[65306]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1043.801304] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.801304] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ca47d813-3b19-4aa2-8339-4f933a85963f is going to be deleted. [ 1043.802481] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.803109] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.826527] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.826724] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3bb1834c-39ac-4ba9-bce1-44f7a4805a24 is going to be deleted. [ 1043.827826] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.828144] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.849813] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.849979] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.855239] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.855399] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c9bd98cc-e392-44de-a51c-e4fc7d37da1f is going to be deleted. [ 1043.856510] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.857226] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.872859] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.873134] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.900696] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.900696] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7f0c403f-7209-472e-8592-d169f66791c9 is going to be deleted. [ 1043.901707] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.901976] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.924371] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.924695] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.954489] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.954716] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: aceee07e-3675-474c-96e8-9fe510f1356f is going to be deleted. [ 1043.957030] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.957030] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.004393] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.004631] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c90bbe47-7f68-400a-a228-2030ba9cad31 is going to be deleted. [ 1044.005820] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.006121] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.034047] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.034168] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.047637] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.047813] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 99194846-a5d9-4dff-8a78-5c66da2ee811 is going to be deleted. [ 1044.048997] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.049286] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.102688] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.102907] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.119552] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.119918] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.128714] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.128942] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ef5de9e7-0c3b-4386-af3c-de134eff75f3 is going to be deleted. [ 1044.129820] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.130418] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.162971] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9e80329d-1fcd-4c50-8991-a90e2a1fbdbc in Status: SUCCESS [ 1044.163383] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9e80329d-1fcd-4c50-8991-a90e2a1fbdbc" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.163522] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9e80329d-1fcd-4c50-8991-a90e2a1fbdbc" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.163667] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9e80329d-1fcd-4c50-8991-a90e2a1fbdbc" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.163865] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.163983] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.164064] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.164229] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.164311] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.164399] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9e80329d-1fcd-4c50-8991-a90e2a1fbdbc" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.164508] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9e80329d-1fcd-4c50-8991-a90e2a1fbdbc',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1044.171430] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('979b0e99-7f65-434d-a9e9-1ff018f5b499',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1044.172454] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1044.173369] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('50a889c1-6336-4320-94ea-df1e6eaa778c',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1044.177313] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('331be455-1cf8-4667-8d43-bd7a51712610',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1044.192189] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.192261] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 563b7655-db8f-408d-8ce8-bfec6b58c669 is going to be deleted. [ 1044.194210] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.195021] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.197411] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-0cb41b0f-cdd2-4222-95b4-bafd614b7460 taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.197592] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0cb41b0f-cdd2-4222-95b4-bafd614b7460" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.197672] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0cb41b0f-cdd2-4222-95b4-bafd614b7460" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.197955] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0cb41b0f-cdd2-4222-95b4-bafd614b7460" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.199235] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.199424] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.199474] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.199987] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.199987] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.199987] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0cb41b0f-cdd2-4222-95b4-bafd614b7460" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.200206] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-0cb41b0f-cdd2-4222-95b4-bafd614b7460 taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.200351] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0cb41b0f-cdd2-4222-95b4-bafd614b7460" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.200426] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0cb41b0f-cdd2-4222-95b4-bafd614b7460" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.200628] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0cb41b0f-cdd2-4222-95b4-bafd614b7460" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.200797] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.200901] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.200972] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.201150] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.201230] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.201333] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0cb41b0f-cdd2-4222-95b4-bafd614b7460" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.201437] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0cb41b0f-cdd2-4222-95b4-bafd614b7460',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1044.204624] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.205085] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.205085] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('37349b8b-c2c1-4141-8b10-752c27492cbd',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1044.248596] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.248759] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d7a326c8-f35c-48c1-831b-ebd2cbb656e7 is going to be deleted. [ 1044.249845] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.251319] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.288270] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.288453] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.305343] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.305537] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.329959] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.330290] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 18bb45c8-7cab-44a5-887c-82deb65b8e26 is going to be deleted. [ 1044.331311] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.331544] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.381230] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.381434] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8beaaac6-ba63-44e8-a960-7e228e2e7d37 is going to be deleted. [ 1044.382620] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.382843] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.428193] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.428430] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.437778] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.437981] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 57bb6fe9-98c4-47f0-9daa-c424a0c9dfee is going to be deleted. [ 1044.439071] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.439314] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.439418] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.439540] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0defdd0d-cdbe-4a7c-9871-fd4c40a3847e" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.439706] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.439872] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.439946] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.440097] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ca47d813-3b19-4aa2-8339-4f933a85963f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.440737] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.440931] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.441075] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.441124] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3bb1834c-39ac-4ba9-bce1-44f7a4805a24" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.441264] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.441421] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.441492] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.441601] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c9bd98cc-e392-44de-a51c-e4fc7d37da1f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.441765] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.441879] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.441952] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.442074] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7f0c403f-7209-472e-8592-d169f66791c9" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.442321] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.442476] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.442676] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.442764] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-aceee07e-3675-474c-96e8-9fe510f1356f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.442898] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.443060] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.443126] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.443248] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c90bbe47-7f68-400a-a228-2030ba9cad31" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.443375] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.443517] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.443593] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.443695] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-99194846-a5d9-4dff-8a78-5c66da2ee811" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.443822] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.443957] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.444044] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.444168] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ef5de9e7-0c3b-4386-af3c-de134eff75f3" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.444370] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.444511] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.444604] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.444712] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-563b7655-db8f-408d-8ce8-bfec6b58c669" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.449991] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.450240] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.450292] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.450516] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.450611] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.450735] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d7a326c8-f35c-48c1-831b-ebd2cbb656e7" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.528974] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.528974] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.529250] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.529300] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.529437] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.529748] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-18bb45c8-7cab-44a5-887c-82deb65b8e26" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.568731] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.568921] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.569012] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.569200] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.569303] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.569432] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8beaaac6-ba63-44e8-a960-7e228e2e7d37" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.575374] env[65306]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1044.575826] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.576014] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.576308] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.576424] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.576424] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.576584] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-57bb6fe9-98c4-47f0-9daa-c424a0c9dfee" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.668287] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-9e80329d-1fcd-4c50-8991-a90e2a1fbdbc taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.668498] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9e80329d-1fcd-4c50-8991-a90e2a1fbdbc" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.668583] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9e80329d-1fcd-4c50-8991-a90e2a1fbdbc" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.668779] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9e80329d-1fcd-4c50-8991-a90e2a1fbdbc" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.668954] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.669056] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.669116] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.669311] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.669375] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.669493] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9e80329d-1fcd-4c50-8991-a90e2a1fbdbc" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.669695] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-9e80329d-1fcd-4c50-8991-a90e2a1fbdbc taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.669789] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9e80329d-1fcd-4c50-8991-a90e2a1fbdbc" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.669848] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9e80329d-1fcd-4c50-8991-a90e2a1fbdbc" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.670017] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9e80329d-1fcd-4c50-8991-a90e2a1fbdbc" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.670166] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.670271] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.670335] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.670476] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.670576] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.670641] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9e80329d-1fcd-4c50-8991-a90e2a1fbdbc" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.670715] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9e80329d-1fcd-4c50-8991-a90e2a1fbdbc',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1044.678867] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 979b0e99-7f65-434d-a9e9-1ff018f5b499: rpc.has_security_group_logging(os_id): False [ 1044.680402] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.680611] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.680694] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.680997] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.681083] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.681189] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d is going to be created. [ 1044.682888] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 50a889c1-6336-4320-94ea-df1e6eaa778c: rpc.has_security_group_logging(os_id): False [ 1044.683369] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 331be455-1cf8-4667-8d43-bd7a51712610: rpc.has_security_group_logging(os_id): False [ 1044.707962] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0cb41b0f-cdd2-4222-95b4-bafd614b7460: rpc.has_security_group_logging(os_id): False [ 1044.711256] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.711465] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.711570] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.711812] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.713062] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 37349b8b-c2c1-4141-8b10-752c27492cbd: rpc.has_security_group_logging(os_id): False [ 1044.714805] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.714943] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.716787] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.716955] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.739031] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.739125] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.740382] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.740382] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.741049] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.741184] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.741244] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.741443] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.741604] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.744250] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.744513] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.744604] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.744701] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.744893] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.744974] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.745084] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 331be455-1cf8-4667-8d43-bd7a51712610 is going to be updated. [ 1044.746085] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.746299] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.755927] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d in Status: UNINITIALIZED for 2s [ 1044.796702] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.797059] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.797165] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.797244] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.797480] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.797567] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.797671] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 50a889c1-6336-4320-94ea-df1e6eaa778c is going to be updated. [ 1044.798753] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.798928] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.839958] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.839958] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.840408] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.840408] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.840644] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.840776] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.841025] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.841141] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.841207] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.841420] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.841499] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.841706] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.841790] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.841892] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.842066] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.842213] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.842351] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0cb41b0f-cdd2-4222-95b4-bafd614b7460 is going to be updated. [ 1044.843575] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.843750] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.902710] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.902904] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.923523] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.923979] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.924206] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.924206] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.924422] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.924515] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.924628] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 979b0e99-7f65-434d-a9e9-1ff018f5b499 is going to be updated. [ 1044.925929] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.926144] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.978130] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.978546] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.978668] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.978747] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.978976] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.979121] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.979199] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 37349b8b-c2c1-4141-8b10-752c27492cbd is going to be updated. [ 1044.980505] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.980724] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.981291] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.001252] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 331be455-1cf8-4667-8d43-bd7a51712610 in Status: IN_PROGRESS for 2s [ 1045.008072] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.008271] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.008341] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.008602] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.008917] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.050695] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.050980] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.050980] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.051188] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.051365] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.061449] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 50a889c1-6336-4320-94ea-df1e6eaa778c in Status: IN_PROGRESS for 2s [ 1045.072020] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0cb41b0f-cdd2-4222-95b4-bafd614b7460 in Status: IN_PROGRESS for 2s [ 1045.085339] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.085656] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.085656] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.085909] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.086080] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.118098] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 979b0e99-7f65-434d-a9e9-1ff018f5b499 in Status: IN_PROGRESS for 2s [ 1045.175503] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.175503] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.175503] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.175503] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.175503] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.178186] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9e80329d-1fcd-4c50-8991-a90e2a1fbdbc: rpc.has_security_group_logging(os_id): False [ 1045.218586] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.218586] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.218586] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.218586] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.220816] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 37349b8b-c2c1-4141-8b10-752c27492cbd in Status: IN_PROGRESS for 2s [ 1045.266727] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.266727] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.266727] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.266727] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.266727] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.266727] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.266727] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.267400] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.267678] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.268333] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.268776] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.269257] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.269747] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.272023] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.272023] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.272023] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.272023] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9e80329d-1fcd-4c50-8991-a90e2a1fbdbc is going to be updated. [ 1045.457270] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.457270] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.457270] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.457270] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.457270] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.494775] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9e80329d-1fcd-4c50-8991-a90e2a1fbdbc in Status: IN_PROGRESS for 2s [ 1046.203251] env[65306]: INFO networking_nsxv3.common.synchronization [req-078f2b94-364c-45ef-895b-e337f3ae90c5 req-a1800ad5-6c25-4c87-af8a-710c490f1dfe tempest-ImagesNegativeTestJSON-703159048 tempest-ImagesNegativeTestJSON-703159048-project-member] Enqueued Resource ID: 17a26b80-c2ff-49b2-a30b-bd2b600f8787 with Priority: HIGHEST for action security_group_members [ 1046.205058] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 17a26b80-c2ff-49b2-a30b-bd2b600f8787 with Priority: HIGHEST for action security_group_members [ 1046.205058] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-17a26b80-c2ff-49b2-a30b-bd2b600f8787 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.205058] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-17a26b80-c2ff-49b2-a30b-bd2b600f8787" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.205058] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-17a26b80-c2ff-49b2-a30b-bd2b600f8787" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.205517] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-17a26b80-c2ff-49b2-a30b-bd2b600f8787" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.205517] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.205666] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.205666] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.208328] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.208328] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.208328] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('17a26b80-c2ff-49b2-a30b-bd2b600f8787',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1046.679874] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock network-26 taken with stack trace [, , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.680156] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "network-26" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.680320] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "network-26" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.680791] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "network-26" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.683654] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.683838] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.683960] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.684362] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.684541] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.684784] env[65306]: DEBUG dogpile.cache.region [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] No value present for key: 'zone-id' {{(pid=65306) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1046.684899] env[65306]: DEBUG dogpile.lock [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] NeedRegenerationException {{(pid=65306) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1046.685025] env[65306]: DEBUG dogpile.lock [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] no value, waiting for create lock {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1046.685135] env[65306]: DEBUG dogpile.lock [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] value creation lock acquired {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1046.685248] env[65306]: DEBUG dogpile.cache.region [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] No value present for key: 'zone-id' {{(pid=65306) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1046.685355] env[65306]: DEBUG dogpile.lock [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Calling creation function for not-yet-present value {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1046.685506] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1046.707691] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1046.707902] env[65306]: DEBUG dogpile.cache.region [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65306) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1046.708534] env[65306]: DEBUG dogpile.lock [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Released creation lock {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1046.708534] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "network-26" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.708666] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock port-6d0bce0c-a414-41c2-b781-0a9bd64d8b55 taken with stack trace [, , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.708835] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "port-6d0bce0c-a414-41c2-b781-0a9bd64d8b55" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.708999] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "port-6d0bce0c-a414-41c2-b781-0a9bd64d8b55" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.709356] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "port-6d0bce0c-a414-41c2-b781-0a9bd64d8b55" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.709556] env[65306]: DEBUG networking_nsxv3.api.rpc [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6d0bce0c-a414-41c2-b781-0a9bd64d8b55',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1046.710803] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.710926] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.711007] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.711191] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.711432] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.711496] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.711567] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.711621] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.711815] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.711897] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.712044] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 17a26b80-c2ff-49b2-a30b-bd2b600f8787 already deleted. [ 1046.712278] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-17a26b80-c2ff-49b2-a30b-bd2b600f8787" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.769531] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d in Status: SUCCESS [ 1046.769531] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.769782] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.769916] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.770248] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.770443] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.770506] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.770670] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.770773] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.770887] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.770988] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1047.016154] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 331be455-1cf8-4667-8d43-bd7a51712610 in Status: SUCCESS [ 1047.016458] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-331be455-1cf8-4667-8d43-bd7a51712610" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.079477] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 50a889c1-6336-4320-94ea-df1e6eaa778c in Status: SUCCESS [ 1047.079755] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-50a889c1-6336-4320-94ea-df1e6eaa778c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.086113] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0cb41b0f-cdd2-4222-95b4-bafd614b7460 in Status: SUCCESS [ 1047.086507] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0cb41b0f-cdd2-4222-95b4-bafd614b7460" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.133035] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 979b0e99-7f65-434d-a9e9-1ff018f5b499 in Status: SUCCESS [ 1047.133325] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-979b0e99-7f65-434d-a9e9-1ff018f5b499" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.214438] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.214905] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.215150] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.215573] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.215821] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.216171] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Segment Port 6d0bce0c-a414-41c2-b781-0a9bd64d8b55 not found, creating... [ 1047.216850] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.217162] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.217358] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.217712] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.218053] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.218546] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.218795] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.218978] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.219399] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.219633] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.219873] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Resource: SegmentPort with ID: 6d0bce0c-a414-41c2-b781-0a9bd64d8b55 is going to be created. [ 1047.237213] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 37349b8b-c2c1-4141-8b10-752c27492cbd in Status: SUCCESS [ 1047.237546] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-37349b8b-c2c1-4141-8b10-752c27492cbd" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.243809] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.244128] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.244327] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.244668] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.244999] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.245163] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "port-6d0bce0c-a414-41c2-b781-0a9bd64d8b55" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.274605] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.274749] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.274889] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.275105] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.275338] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.275575] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.277079] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.277079] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.277079] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.277079] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.277079] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.277079] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.277079] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.277079] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.277079] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.277079] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.277079] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.277681] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.277681] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.277681] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.277681] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1047.526139] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9e80329d-1fcd-4c50-8991-a90e2a1fbdbc in Status: SUCCESS [ 1047.526394] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9e80329d-1fcd-4c50-8991-a90e2a1fbdbc" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.526576] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9e80329d-1fcd-4c50-8991-a90e2a1fbdbc" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.526821] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9e80329d-1fcd-4c50-8991-a90e2a1fbdbc" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.526912] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9e80329d-1fcd-4c50-8991-a90e2a1fbdbc',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1047.779453] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d: rpc.has_security_group_logging(os_id): False [ 1047.799690] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.799890] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.800087] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.800196] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.800292] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.800529] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.800634] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.800720] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.800898] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.801031] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.801238] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.801341] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.801405] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.801688] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.801798] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.802020] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.802148] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.802239] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.802402] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.802485] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.802584] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d is going to be created. [ 1047.901689] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.901834] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.901903] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.902250] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.902468] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.921925] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d in Status: IN_PROGRESS for 2s [ 1047.958461] env[65306]: INFO networking_nsxv3.common.synchronization [req-078f2b94-364c-45ef-895b-e337f3ae90c5 req-3ca36ed5-c8b4-43ed-8481-286eb5d134be service nova] Enqueued Resource ID: 17a26b80-c2ff-49b2-a30b-bd2b600f8787 with Priority: HIGHEST for action security_group_rules [ 1047.958461] env[65306]: INFO networking_nsxv3.common.synchronization [req-078f2b94-364c-45ef-895b-e337f3ae90c5 req-3ca36ed5-c8b4-43ed-8481-286eb5d134be service nova] Enqueued Resource ID: 17a26b80-c2ff-49b2-a30b-bd2b600f8787 with Priority: HIGHEST for action security_group_members [ 1047.958582] env[65306]: INFO networking_nsxv3.common.synchronization [req-078f2b94-364c-45ef-895b-e337f3ae90c5 req-3ca36ed5-c8b4-43ed-8481-286eb5d134be service nova] Enqueued Resource ID: 6d0bce0c-a414-41c2-b781-0a9bd64d8b55 with Priority: HIGHEST for action port [ 1047.959418] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 17a26b80-c2ff-49b2-a30b-bd2b600f8787 with Priority: HIGHEST for action security_group_rules [ 1047.959623] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 17a26b80-c2ff-49b2-a30b-bd2b600f8787 with Priority: HIGHEST for action security_group_members [ 1047.959809] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6d0bce0c-a414-41c2-b781-0a9bd64d8b55 with Priority: HIGHEST for action port [ 1047.960249] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock rules-17a26b80-c2ff-49b2-a30b-bd2b600f8787 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.960383] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-17a26b80-c2ff-49b2-a30b-bd2b600f8787" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.960518] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-17a26b80-c2ff-49b2-a30b-bd2b600f8787" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.960912] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-17a26b80-c2ff-49b2-a30b-bd2b600f8787" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.960953] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('17a26b80-c2ff-49b2-a30b-bd2b600f8787',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1047.965177] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-17a26b80-c2ff-49b2-a30b-bd2b600f8787 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.965177] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-17a26b80-c2ff-49b2-a30b-bd2b600f8787" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.965177] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-17a26b80-c2ff-49b2-a30b-bd2b600f8787" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.965177] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-17a26b80-c2ff-49b2-a30b-bd2b600f8787" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.965177] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.965177] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.965177] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.965177] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.965177] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.965177] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('17a26b80-c2ff-49b2-a30b-bd2b600f8787',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1047.965177] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock port-6d0bce0c-a414-41c2-b781-0a9bd64d8b55 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.965177] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6d0bce0c-a414-41c2-b781-0a9bd64d8b55" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.965177] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6d0bce0c-a414-41c2-b781-0a9bd64d8b55" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.965895] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6d0bce0c-a414-41c2-b781-0a9bd64d8b55" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.965895] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6d0bce0c-a414-41c2-b781-0a9bd64d8b55',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1048.029651] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-9e80329d-1fcd-4c50-8991-a90e2a1fbdbc taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.029965] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9e80329d-1fcd-4c50-8991-a90e2a1fbdbc" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.030066] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9e80329d-1fcd-4c50-8991-a90e2a1fbdbc" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.030363] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9e80329d-1fcd-4c50-8991-a90e2a1fbdbc" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.030545] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.030651] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.030713] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.030878] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.030970] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.031086] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9e80329d-1fcd-4c50-8991-a90e2a1fbdbc" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.031176] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9e80329d-1fcd-4c50-8991-a90e2a1fbdbc',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1048.331197] env[65306]: INFO networking_nsxv3.common.synchronization [req-b57f119d-d282-4973-8e51-630a2e5d53d1 req-83e751f6-3e2b-4520-8bf8-8f16d5131d8d tempest-ServersTestJSON-1773114292 tempest-ServersTestJSON-1773114292-project-member] Enqueued Resource ID: 0cb41b0f-cdd2-4222-95b4-bafd614b7460 with Priority: HIGHEST for action security_group_members [ 1048.331478] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0cb41b0f-cdd2-4222-95b4-bafd614b7460 with Priority: HIGHEST for action security_group_members [ 1048.333209] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-0cb41b0f-cdd2-4222-95b4-bafd614b7460 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.333209] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0cb41b0f-cdd2-4222-95b4-bafd614b7460" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.333209] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0cb41b0f-cdd2-4222-95b4-bafd614b7460" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.333209] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0cb41b0f-cdd2-4222-95b4-bafd614b7460" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.333209] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.333209] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.333209] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.333209] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.333209] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.333209] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0cb41b0f-cdd2-4222-95b4-bafd614b7460',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1048.467697] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-17a26b80-c2ff-49b2-a30b-bd2b600f8787 taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.467861] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-17a26b80-c2ff-49b2-a30b-bd2b600f8787" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.468084] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('17a26b80-c2ff-49b2-a30b-bd2b600f8787',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1048.469105] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6d0bce0c-a414-41c2-b781-0a9bd64d8b55 with status ACTIVE [ 1048.469374] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.469476] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.469476] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.469678] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.469764] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.469932] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.470221] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.470347] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.470550] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.471477] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.471477] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.471477] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.471477] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.471477] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.471748] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.471748] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6d0bce0c-a414-41c2-b781-0a9bd64d8b55 is going to be updated. [ 1048.493711] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.493846] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.494204] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.494864] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.500456] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.500456] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6d0bce0c-a414-41c2-b781-0a9bd64d8b55" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.534093] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-9e80329d-1fcd-4c50-8991-a90e2a1fbdbc taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.534273] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9e80329d-1fcd-4c50-8991-a90e2a1fbdbc" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.534352] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9e80329d-1fcd-4c50-8991-a90e2a1fbdbc" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.534602] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9e80329d-1fcd-4c50-8991-a90e2a1fbdbc" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.534795] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.534898] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.534964] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.535175] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.535254] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.535453] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9e80329d-1fcd-4c50-8991-a90e2a1fbdbc" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.535563] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-9e80329d-1fcd-4c50-8991-a90e2a1fbdbc taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.535652] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9e80329d-1fcd-4c50-8991-a90e2a1fbdbc" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.535709] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9e80329d-1fcd-4c50-8991-a90e2a1fbdbc" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.535855] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9e80329d-1fcd-4c50-8991-a90e2a1fbdbc" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.535993] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.536098] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.536217] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.536295] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.536370] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.536449] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9e80329d-1fcd-4c50-8991-a90e2a1fbdbc" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.536540] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9e80329d-1fcd-4c50-8991-a90e2a1fbdbc',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1048.713641] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock network-949 taken with stack trace [, , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.713844] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "network-949" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.713971] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "network-949" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.714264] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "network-949" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.714555] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.714671] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.714787] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.715023] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.718167] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.718418] env[65306]: DEBUG dogpile.cache.region [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] No value present for key: 'zone-id' {{(pid=65306) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1048.718554] env[65306]: DEBUG dogpile.lock [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] NeedRegenerationException {{(pid=65306) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1048.718702] env[65306]: DEBUG dogpile.lock [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] no value, waiting for create lock {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1048.718823] env[65306]: DEBUG dogpile.lock [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] value creation lock acquired {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1048.719400] env[65306]: DEBUG dogpile.cache.region [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] No value present for key: 'zone-id' {{(pid=65306) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1048.719400] env[65306]: DEBUG dogpile.lock [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Calling creation function for not-yet-present value {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1048.719400] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1048.739030] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1048.739030] env[65306]: DEBUG dogpile.cache.region [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65306) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1048.739323] env[65306]: DEBUG dogpile.lock [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Released creation lock {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1048.739557] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "network-949" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.739736] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock port-4bf9ef4b-dc02-4418-813a-67461d8487bb taken with stack trace [, , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.739922] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "port-4bf9ef4b-dc02-4418-813a-67461d8487bb" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.740073] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "port-4bf9ef4b-dc02-4418-813a-67461d8487bb" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.740510] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "port-4bf9ef4b-dc02-4418-813a-67461d8487bb" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.740674] env[65306]: DEBUG networking_nsxv3.api.rpc [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4bf9ef4b-dc02-4418-813a-67461d8487bb',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1048.836396] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0cb41b0f-cdd2-4222-95b4-bafd614b7460',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1048.974140] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('17a26b80-c2ff-49b2-a30b-bd2b600f8787',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1049.043184] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9e80329d-1fcd-4c50-8991-a90e2a1fbdbc: rpc.has_security_group_logging(os_id): False [ 1049.062435] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.062737] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.062737] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.063026] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.063966] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.063966] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.063966] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.063966] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.064226] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.064226] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.064487] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.064656] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.064777] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.065154] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.065472] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.065472] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.065674] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.065792] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.065953] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.066101] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.066246] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9e80329d-1fcd-4c50-8991-a90e2a1fbdbc is going to be updated. [ 1049.136543] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.136677] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.136758] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.136966] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.137115] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.156113] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9e80329d-1fcd-4c50-8991-a90e2a1fbdbc in Status: IN_PROGRESS for 2s [ 1049.247408] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.247639] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.247779] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.248117] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.248294] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.248511] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Segment Port 4bf9ef4b-dc02-4418-813a-67461d8487bb not found, creating... [ 1049.249476] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.249476] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.249476] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.249476] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.249476] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.249814] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.250235] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.250235] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.250352] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.250419] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.250565] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Resource: SegmentPort with ID: 4bf9ef4b-dc02-4418-813a-67461d8487bb is going to be created. [ 1049.279892] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.280135] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.280310] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.280632] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.280875] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.281124] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "port-4bf9ef4b-dc02-4418-813a-67461d8487bb" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.339622] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0cb41b0f-cdd2-4222-95b4-bafd614b7460',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1049.477097] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.477320] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.477491] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.477920] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.478056] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.478211] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 17a26b80-c2ff-49b2-a30b-bd2b600f8787 is going to be created. [ 1049.503258] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.503434] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.503479] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.503820] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.503994] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.526879] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 17a26b80-c2ff-49b2-a30b-bd2b600f8787 in Status: UNINITIALIZED for 2s [ 1049.842617] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.842967] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.842967] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.843119] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.843215] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.843304] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0cb41b0f-cdd2-4222-95b4-bafd614b7460 is going to be updated. [ 1049.876499] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.876499] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.876499] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.876499] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.876499] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.893730] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0cb41b0f-cdd2-4222-95b4-bafd614b7460 in Status: IN_PROGRESS for 2s [ 1049.949317] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d in Status: SUCCESS [ 1049.949556] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.998543] env[65306]: INFO networking_nsxv3.common.synchronization [req-b57f119d-d282-4973-8e51-630a2e5d53d1 req-260da61a-b098-4245-8a9a-26d519fd09a1 service nova] Enqueued Resource ID: 0cb41b0f-cdd2-4222-95b4-bafd614b7460 with Priority: HIGHEST for action security_group_rules [ 1049.998736] env[65306]: INFO networking_nsxv3.common.synchronization [req-b57f119d-d282-4973-8e51-630a2e5d53d1 req-260da61a-b098-4245-8a9a-26d519fd09a1 service nova] Enqueued Resource ID: 0cb41b0f-cdd2-4222-95b4-bafd614b7460 with Priority: HIGHEST for action security_group_members [ 1049.998955] env[65306]: INFO networking_nsxv3.common.synchronization [req-b57f119d-d282-4973-8e51-630a2e5d53d1 req-260da61a-b098-4245-8a9a-26d519fd09a1 service nova] Enqueued Resource ID: 4bf9ef4b-dc02-4418-813a-67461d8487bb with Priority: HIGHEST for action port [ 1049.999603] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0cb41b0f-cdd2-4222-95b4-bafd614b7460 with Priority: HIGHEST for action security_group_rules [ 1049.999774] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0cb41b0f-cdd2-4222-95b4-bafd614b7460 with Priority: HIGHEST for action security_group_members [ 1049.999887] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4bf9ef4b-dc02-4418-813a-67461d8487bb with Priority: HIGHEST for action port [ 1050.000283] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0cb41b0f-cdd2-4222-95b4-bafd614b7460 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.000398] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0cb41b0f-cdd2-4222-95b4-bafd614b7460" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.000469] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0cb41b0f-cdd2-4222-95b4-bafd614b7460" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.000756] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0cb41b0f-cdd2-4222-95b4-bafd614b7460" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.000756] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0cb41b0f-cdd2-4222-95b4-bafd614b7460',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1050.002028] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-0cb41b0f-cdd2-4222-95b4-bafd614b7460 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.002101] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0cb41b0f-cdd2-4222-95b4-bafd614b7460" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.002374] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock port-4bf9ef4b-dc02-4418-813a-67461d8487bb taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.002498] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4bf9ef4b-dc02-4418-813a-67461d8487bb" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.002564] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4bf9ef4b-dc02-4418-813a-67461d8487bb" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.002753] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4bf9ef4b-dc02-4418-813a-67461d8487bb" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.002834] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4bf9ef4b-dc02-4418-813a-67461d8487bb',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1050.504782] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-0cb41b0f-cdd2-4222-95b4-bafd614b7460 taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.505124] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0cb41b0f-cdd2-4222-95b4-bafd614b7460" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.505174] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4bf9ef4b-dc02-4418-813a-67461d8487bb with status ACTIVE [ 1050.505337] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.505446] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.505510] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.505710] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.505797] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.505967] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.506077] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.506188] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.506277] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.506354] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.506532] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.506619] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.506681] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.506814] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.506887] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.506972] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4bf9ef4b-dc02-4418-813a-67461d8487bb is going to be updated. [ 1050.532483] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.532643] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.532713] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.532973] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.533140] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.533374] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4bf9ef4b-dc02-4418-813a-67461d8487bb" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.183631] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9e80329d-1fcd-4c50-8991-a90e2a1fbdbc in Status: SUCCESS [ 1051.183902] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9e80329d-1fcd-4c50-8991-a90e2a1fbdbc" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.538177] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 17a26b80-c2ff-49b2-a30b-bd2b600f8787 in Status: SUCCESS [ 1051.538515] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-17a26b80-c2ff-49b2-a30b-bd2b600f8787" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.538571] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-17a26b80-c2ff-49b2-a30b-bd2b600f8787" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.538933] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-17a26b80-c2ff-49b2-a30b-bd2b600f8787" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.539170] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.539348] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.539348] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.539521] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.539595] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.539679] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-17a26b80-c2ff-49b2-a30b-bd2b600f8787" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.539773] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('17a26b80-c2ff-49b2-a30b-bd2b600f8787',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1051.746469] env[65306]: INFO networking_nsxv3.common.synchronization [req-78711c93-8f96-4d8b-a3a0-a32bb177804b req-4c378bb4-c6b8-4f08-a4d8-ad98b4e56711 tempest-ServerGroupTestJSON-642980956 tempest-ServerGroupTestJSON-642980956-project-member] Enqueued Resource ID: f2738afc-1df7-4958-9efd-71a6bbe54e6e with Priority: HIGHEST for action security_group_members [ 1051.747153] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f2738afc-1df7-4958-9efd-71a6bbe54e6e with Priority: HIGHEST for action security_group_members [ 1051.747530] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-f2738afc-1df7-4958-9efd-71a6bbe54e6e taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.747693] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f2738afc-1df7-4958-9efd-71a6bbe54e6e" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.747750] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f2738afc-1df7-4958-9efd-71a6bbe54e6e" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.748107] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f2738afc-1df7-4958-9efd-71a6bbe54e6e" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.748195] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.748260] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.748375] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.748473] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.748558] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.748653] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f2738afc-1df7-4958-9efd-71a6bbe54e6e',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1051.910919] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0cb41b0f-cdd2-4222-95b4-bafd614b7460 in Status: SUCCESS [ 1051.911237] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0cb41b0f-cdd2-4222-95b4-bafd614b7460" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.911360] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0cb41b0f-cdd2-4222-95b4-bafd614b7460" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.911600] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0cb41b0f-cdd2-4222-95b4-bafd614b7460" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.912529] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.912529] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.912529] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.912529] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.912529] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.912529] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0cb41b0f-cdd2-4222-95b4-bafd614b7460',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1052.042372] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-17a26b80-c2ff-49b2-a30b-bd2b600f8787 taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.042541] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-17a26b80-c2ff-49b2-a30b-bd2b600f8787" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.042541] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-17a26b80-c2ff-49b2-a30b-bd2b600f8787" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.042844] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-17a26b80-c2ff-49b2-a30b-bd2b600f8787" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.043038] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.043142] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.043208] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.043365] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.043454] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.043557] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-17a26b80-c2ff-49b2-a30b-bd2b600f8787" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.043708] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-17a26b80-c2ff-49b2-a30b-bd2b600f8787 taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.043876] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-17a26b80-c2ff-49b2-a30b-bd2b600f8787" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.043876] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-17a26b80-c2ff-49b2-a30b-bd2b600f8787" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.044072] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-17a26b80-c2ff-49b2-a30b-bd2b600f8787" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.044220] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.044331] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.044396] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.044532] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.044629] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.044709] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-17a26b80-c2ff-49b2-a30b-bd2b600f8787" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.044800] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('17a26b80-c2ff-49b2-a30b-bd2b600f8787',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1052.130344] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock network-675 taken with stack trace [, , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.130627] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "network-675" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.130830] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "network-675" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.131206] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "network-675" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.131587] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.131805] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.131975] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.132346] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.132546] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.132851] env[65306]: DEBUG dogpile.cache.region [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] No value present for key: 'zone-id' {{(pid=65306) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1052.133045] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] NeedRegenerationException {{(pid=65306) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1052.133241] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] no value, waiting for create lock {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1052.133368] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] value creation lock acquired {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1052.133538] env[65306]: DEBUG dogpile.cache.region [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] No value present for key: 'zone-id' {{(pid=65306) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1052.133736] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Calling creation function for not-yet-present value {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1052.133915] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1052.157053] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1052.157232] env[65306]: DEBUG dogpile.cache.region [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65306) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1052.157373] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Released creation lock {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1052.157554] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "network-675" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.158050] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock port-151b7319-954b-4f6b-9c11-0c3cb31e6d2a taken with stack trace [, , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.158234] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "port-151b7319-954b-4f6b-9c11-0c3cb31e6d2a" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.158362] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "port-151b7319-954b-4f6b-9c11-0c3cb31e6d2a" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.158684] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "port-151b7319-954b-4f6b-9c11-0c3cb31e6d2a" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.158825] env[65306]: DEBUG networking_nsxv3.api.rpc [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('151b7319-954b-4f6b-9c11-0c3cb31e6d2a',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1052.251279] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.251548] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.251674] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.251909] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.252044] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.252246] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.252406] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.252484] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.252655] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.252720] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.252823] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f2738afc-1df7-4958-9efd-71a6bbe54e6e already deleted. [ 1052.252906] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f2738afc-1df7-4958-9efd-71a6bbe54e6e" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.417366] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0cb41b0f-cdd2-4222-95b4-bafd614b7460',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1052.551351] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 17a26b80-c2ff-49b2-a30b-bd2b600f8787: rpc.has_security_group_logging(os_id): False [ 1052.574021] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.574021] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.574021] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.574021] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.574021] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.574021] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.574021] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.574021] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.574021] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.574021] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.574021] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.574021] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.574021] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.574021] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.574021] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.574674] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.576793] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.576793] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.576793] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.576793] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.576793] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 17a26b80-c2ff-49b2-a30b-bd2b600f8787 is going to be created. [ 1052.637323] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.637560] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.637613] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.637858] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.638132] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.650068] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 17a26b80-c2ff-49b2-a30b-bd2b600f8787 in Status: IN_PROGRESS for 2s [ 1052.664561] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.664899] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.665075] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.665380] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.665544] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.665684] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Segment Port 151b7319-954b-4f6b-9c11-0c3cb31e6d2a not found, creating... [ 1052.665953] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.666149] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.666253] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.666485] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.666626] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.666914] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.667109] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.667241] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.667469] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.667619] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.667764] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Resource: SegmentPort with ID: 151b7319-954b-4f6b-9c11-0c3cb31e6d2a is going to be created. [ 1052.693951] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.694201] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.694331] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.694729] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.694995] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.695251] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "port-151b7319-954b-4f6b-9c11-0c3cb31e6d2a" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.920799] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0cb41b0f-cdd2-4222-95b4-bafd614b7460',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1053.423341] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.423625] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.423709] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.423974] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.424149] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.424284] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0cb41b0f-cdd2-4222-95b4-bafd614b7460 is going to be updated. [ 1053.441031] env[65306]: INFO networking_nsxv3.common.synchronization [req-78711c93-8f96-4d8b-a3a0-a32bb177804b req-d0f4c1e9-c54d-48ec-8911-5ad5449dcee4 service nova] Enqueued Resource ID: f2738afc-1df7-4958-9efd-71a6bbe54e6e with Priority: HIGHEST for action security_group_rules [ 1053.441031] env[65306]: INFO networking_nsxv3.common.synchronization [req-78711c93-8f96-4d8b-a3a0-a32bb177804b req-d0f4c1e9-c54d-48ec-8911-5ad5449dcee4 service nova] Enqueued Resource ID: f2738afc-1df7-4958-9efd-71a6bbe54e6e with Priority: HIGHEST for action security_group_members [ 1053.441031] env[65306]: INFO networking_nsxv3.common.synchronization [req-78711c93-8f96-4d8b-a3a0-a32bb177804b req-d0f4c1e9-c54d-48ec-8911-5ad5449dcee4 service nova] Enqueued Resource ID: 151b7319-954b-4f6b-9c11-0c3cb31e6d2a with Priority: HIGHEST for action port [ 1053.441031] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f2738afc-1df7-4958-9efd-71a6bbe54e6e with Priority: HIGHEST for action security_group_rules [ 1053.441031] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f2738afc-1df7-4958-9efd-71a6bbe54e6e with Priority: HIGHEST for action security_group_members [ 1053.441031] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 151b7319-954b-4f6b-9c11-0c3cb31e6d2a with Priority: HIGHEST for action port [ 1053.441031] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f2738afc-1df7-4958-9efd-71a6bbe54e6e taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.441031] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f2738afc-1df7-4958-9efd-71a6bbe54e6e" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.441031] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f2738afc-1df7-4958-9efd-71a6bbe54e6e" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.441031] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f2738afc-1df7-4958-9efd-71a6bbe54e6e" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.441031] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f2738afc-1df7-4958-9efd-71a6bbe54e6e',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1053.442197] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-f2738afc-1df7-4958-9efd-71a6bbe54e6e taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.442499] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f2738afc-1df7-4958-9efd-71a6bbe54e6e" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.442569] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f2738afc-1df7-4958-9efd-71a6bbe54e6e" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.442759] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f2738afc-1df7-4958-9efd-71a6bbe54e6e" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.443020] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.443188] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.443336] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.443546] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.443677] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.443854] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f2738afc-1df7-4958-9efd-71a6bbe54e6e',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1053.445640] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock port-151b7319-954b-4f6b-9c11-0c3cb31e6d2a taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.445640] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-151b7319-954b-4f6b-9c11-0c3cb31e6d2a" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.445640] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-151b7319-954b-4f6b-9c11-0c3cb31e6d2a" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.445640] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-151b7319-954b-4f6b-9c11-0c3cb31e6d2a" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.445640] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('151b7319-954b-4f6b-9c11-0c3cb31e6d2a',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1053.467755] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.467941] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.468048] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.468931] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.468931] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.490170] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0cb41b0f-cdd2-4222-95b4-bafd614b7460 in Status: IN_PROGRESS for 2s [ 1053.947747] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-f2738afc-1df7-4958-9efd-71a6bbe54e6e taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.948088] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f2738afc-1df7-4958-9efd-71a6bbe54e6e" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.949311] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f2738afc-1df7-4958-9efd-71a6bbe54e6e',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1053.950327] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 151b7319-954b-4f6b-9c11-0c3cb31e6d2a with status ACTIVE [ 1053.950544] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.950666] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.950730] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.950934] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.951042] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.951223] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.951320] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.951381] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.951556] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.951637] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.951821] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.951910] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.951982] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.952133] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.952204] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.952568] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 151b7319-954b-4f6b-9c11-0c3cb31e6d2a is going to be updated. [ 1053.975735] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.976412] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.976500] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.976707] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.976871] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.976994] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-151b7319-954b-4f6b-9c11-0c3cb31e6d2a" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.454623] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f2738afc-1df7-4958-9efd-71a6bbe54e6e',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1054.548283] env[65306]: INFO networking_nsxv3.common.synchronization [req-ab11d084-68b8-4088-862a-b3ec5cf3641c req-3f083ac7-9b42-4a2e-a7dc-7d820249daed tempest-DeleteServersTestJSON-1340326246 tempest-DeleteServersTestJSON-1340326246-project-member] Enqueued Resource ID: d82bad56-9830-4c7d-9763-6d8a05e0998c with Priority: HIGHEST for action security_group_members [ 1054.548815] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d82bad56-9830-4c7d-9763-6d8a05e0998c with Priority: HIGHEST for action security_group_members [ 1054.549134] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-d82bad56-9830-4c7d-9763-6d8a05e0998c taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.549258] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d82bad56-9830-4c7d-9763-6d8a05e0998c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.549325] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d82bad56-9830-4c7d-9763-6d8a05e0998c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.549531] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d82bad56-9830-4c7d-9763-6d8a05e0998c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.549682] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.549777] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.549840] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.549984] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.550659] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.550745] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d82bad56-9830-4c7d-9763-6d8a05e0998c',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1054.661931] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 17a26b80-c2ff-49b2-a30b-bd2b600f8787 in Status: SUCCESS [ 1054.662245] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-17a26b80-c2ff-49b2-a30b-bd2b600f8787" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.959370] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.959806] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.959806] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.959977] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.960278] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.960278] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f2738afc-1df7-4958-9efd-71a6bbe54e6e is going to be created. [ 1054.994272] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.994481] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.994481] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.994676] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.994847] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.009538] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f2738afc-1df7-4958-9efd-71a6bbe54e6e in Status: UNINITIALIZED for 2s [ 1055.054648] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.054890] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.055011] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.055304] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.084599] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.084877] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.085079] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.085151] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.085407] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.085547] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.085607] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d82bad56-9830-4c7d-9763-6d8a05e0998c is going to be updated. [ 1055.132114] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.132205] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.132205] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.132503] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.132663] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.143374] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d82bad56-9830-4c7d-9763-6d8a05e0998c in Status: IN_PROGRESS for 2s [ 1055.499944] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0cb41b0f-cdd2-4222-95b4-bafd614b7460 in Status: SUCCESS [ 1055.500196] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0cb41b0f-cdd2-4222-95b4-bafd614b7460" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.500580] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0cb41b0f-cdd2-4222-95b4-bafd614b7460" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.500806] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0cb41b0f-cdd2-4222-95b4-bafd614b7460" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.501050] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.501153] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.501235] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.501400] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.501485] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.501575] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0cb41b0f-cdd2-4222-95b4-bafd614b7460" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.501669] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0cb41b0f-cdd2-4222-95b4-bafd614b7460',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1055.512925] env[65306]: INFO networking_nsxv3.common.synchronization [req-c0f09d9a-5c8e-4761-b1f6-e88c31d5a7f7 req-ce07e792-6560-4975-bb34-e4ad34b9b05b tempest-ServersAdminTestJSON-2076938379 tempest-ServersAdminTestJSON-2076938379-project-member] Enqueued Resource ID: 56904b3c-38e4-4547-9a1d-cc787c3fef9d with Priority: HIGHEST for action security_group_members [ 1055.517023] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 56904b3c-38e4-4547-9a1d-cc787c3fef9d with Priority: HIGHEST for action security_group_members [ 1055.517023] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-56904b3c-38e4-4547-9a1d-cc787c3fef9d taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.517023] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-56904b3c-38e4-4547-9a1d-cc787c3fef9d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.517023] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-56904b3c-38e4-4547-9a1d-cc787c3fef9d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.517023] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-56904b3c-38e4-4547-9a1d-cc787c3fef9d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.517023] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.517023] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.517023] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.517023] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.517023] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.517023] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('56904b3c-38e4-4547-9a1d-cc787c3fef9d',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1056.004234] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-0cb41b0f-cdd2-4222-95b4-bafd614b7460 taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.004643] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0cb41b0f-cdd2-4222-95b4-bafd614b7460" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.004709] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0cb41b0f-cdd2-4222-95b4-bafd614b7460" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.005020] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0cb41b0f-cdd2-4222-95b4-bafd614b7460" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.005249] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.005419] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.005539] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.005713] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.005829] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.005942] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0cb41b0f-cdd2-4222-95b4-bafd614b7460" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.006181] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-0cb41b0f-cdd2-4222-95b4-bafd614b7460 taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.006310] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0cb41b0f-cdd2-4222-95b4-bafd614b7460" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.006643] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0cb41b0f-cdd2-4222-95b4-bafd614b7460" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.006643] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0cb41b0f-cdd2-4222-95b4-bafd614b7460" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.006877] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.006877] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.007134] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.007203] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.007259] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.007346] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0cb41b0f-cdd2-4222-95b4-bafd614b7460" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.007466] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0cb41b0f-cdd2-4222-95b4-bafd614b7460',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1056.029253] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.029479] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.029589] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.029878] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.055610] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.055852] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.055961] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.056081] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.056278] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.056398] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.056464] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 56904b3c-38e4-4547-9a1d-cc787c3fef9d is going to be updated. [ 1056.088745] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.088745] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.088745] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.088745] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.089092] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.099034] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 56904b3c-38e4-4547-9a1d-cc787c3fef9d in Status: IN_PROGRESS for 2s [ 1056.375715] env[65306]: INFO networking_nsxv3.common.synchronization [req-e962c66a-2d5d-4594-9423-82974ee8b045 req-faff5f6b-b0c6-4d88-ac7b-b26bdfb7094e tempest-AttachInterfacesTestJSON-144464476 tempest-AttachInterfacesTestJSON-144464476-project-member] Enqueued Resource ID: 60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d with Priority: HIGHEST for action security_group_members [ 1056.376288] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d with Priority: HIGHEST for action security_group_members [ 1056.376604] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.376727] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.376792] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.376991] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.377293] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.377408] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.377504] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.377740] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.377834] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.377931] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1056.510523] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0cb41b0f-cdd2-4222-95b4-bafd614b7460: rpc.has_security_group_logging(os_id): False [ 1056.532558] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.532753] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.532803] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.533037] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.533146] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.533772] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.533772] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.533772] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.533772] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.533772] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.534068] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.534068] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.534150] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.534277] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.534363] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.534558] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.534666] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.534796] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.534922] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.534996] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.535265] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0cb41b0f-cdd2-4222-95b4-bafd614b7460 is going to be updated. [ 1056.596038] env[65306]: INFO networking_nsxv3.common.synchronization [req-1c567f29-3ef9-443b-bd70-a6b3bfa4bd73 req-dbdec9d8-0c30-4a24-a37c-f1b2803f390f tempest-ImagesTestJSON-762064805 tempest-ImagesTestJSON-762064805-project-member] Enqueued Resource ID: 57bb6fe9-98c4-47f0-9daa-c424a0c9dfee with Priority: HIGHEST for action security_group_members [ 1056.596038] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 57bb6fe9-98c4-47f0-9daa-c424a0c9dfee with Priority: HIGHEST for action security_group_members [ 1056.596038] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-57bb6fe9-98c4-47f0-9daa-c424a0c9dfee taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.596038] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-57bb6fe9-98c4-47f0-9daa-c424a0c9dfee" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.596038] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-57bb6fe9-98c4-47f0-9daa-c424a0c9dfee" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.596038] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-57bb6fe9-98c4-47f0-9daa-c424a0c9dfee" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.596038] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.596038] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.596038] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.596038] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.596038] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.596038] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('57bb6fe9-98c4-47f0-9daa-c424a0c9dfee',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1056.607620] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.608086] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.608335] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.610041] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.610041] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.636751] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0cb41b0f-cdd2-4222-95b4-bafd614b7460 in Status: IN_PROGRESS for 2s [ 1056.880038] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.881626] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.881626] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.881626] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.881626] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.881995] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.881995] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.881995] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.882143] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.882143] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.882221] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d is going to be updated. [ 1056.913807] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.913807] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.913807] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.913807] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.913807] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.926517] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d in Status: IN_PROGRESS for 2s [ 1057.022800] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f2738afc-1df7-4958-9efd-71a6bbe54e6e in Status: SUCCESS [ 1057.022800] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f2738afc-1df7-4958-9efd-71a6bbe54e6e" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.022800] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f2738afc-1df7-4958-9efd-71a6bbe54e6e" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.022800] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f2738afc-1df7-4958-9efd-71a6bbe54e6e" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.022800] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.022800] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.022800] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.022800] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.022800] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.022800] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f2738afc-1df7-4958-9efd-71a6bbe54e6e" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.022800] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f2738afc-1df7-4958-9efd-71a6bbe54e6e',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1057.060062] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock network-873 taken with stack trace [, , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.060062] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "network-873" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.060062] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "network-873" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.060062] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "network-873" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.060062] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.060062] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.060062] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.060639] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.060922] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.061256] env[65306]: DEBUG dogpile.cache.region [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] No value present for key: 'zone-id' {{(pid=65306) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1057.061511] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] NeedRegenerationException {{(pid=65306) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1057.061721] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] no value, waiting for create lock {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1057.061918] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] value creation lock acquired {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1057.062148] env[65306]: DEBUG dogpile.cache.region [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] No value present for key: 'zone-id' {{(pid=65306) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1057.062370] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Calling creation function for not-yet-present value {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1057.063594] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1057.083486] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1057.083706] env[65306]: DEBUG dogpile.cache.region [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65306) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1057.083853] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Released creation lock {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1057.084091] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "network-873" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.085030] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock port-f074bd97-6171-4067-b753-ebf522c5abf3 taken with stack trace [, , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.085030] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "port-f074bd97-6171-4067-b753-ebf522c5abf3" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.085030] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "port-f074bd97-6171-4067-b753-ebf522c5abf3" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.085259] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "port-f074bd97-6171-4067-b753-ebf522c5abf3" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.085259] env[65306]: DEBUG networking_nsxv3.api.rpc [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f074bd97-6171-4067-b753-ebf522c5abf3',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1057.095753] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.096149] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.096149] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.096149] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.096352] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.096405] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.096510] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.096616] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.096712] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.096786] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.096872] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 57bb6fe9-98c4-47f0-9daa-c424a0c9dfee is going to be deleted. [ 1057.129205] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.129410] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.129410] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.129615] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.129703] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.129803] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-57bb6fe9-98c4-47f0-9daa-c424a0c9dfee" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.154204] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d82bad56-9830-4c7d-9763-6d8a05e0998c in Status: SUCCESS [ 1057.154402] env[65306]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d82bad56-9830-4c7d-9763-6d8a05e0998c deletion is rescheduled due to dependency. [ 1057.154537] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d82bad56-9830-4c7d-9763-6d8a05e0998c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.523925] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-f2738afc-1df7-4958-9efd-71a6bbe54e6e taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.524214] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f2738afc-1df7-4958-9efd-71a6bbe54e6e" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.524365] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f2738afc-1df7-4958-9efd-71a6bbe54e6e" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.524657] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f2738afc-1df7-4958-9efd-71a6bbe54e6e" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.524891] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.525072] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.525188] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.525717] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.525717] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.525878] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f2738afc-1df7-4958-9efd-71a6bbe54e6e" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.525998] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-f2738afc-1df7-4958-9efd-71a6bbe54e6e taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.526172] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f2738afc-1df7-4958-9efd-71a6bbe54e6e" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.526322] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f2738afc-1df7-4958-9efd-71a6bbe54e6e" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.526579] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f2738afc-1df7-4958-9efd-71a6bbe54e6e" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.526834] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.527015] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.527153] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.527367] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.527504] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.527653] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f2738afc-1df7-4958-9efd-71a6bbe54e6e" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.527807] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f2738afc-1df7-4958-9efd-71a6bbe54e6e',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1057.588045] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.588232] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.588318] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.590566] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.590566] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.590723] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Segment Port f074bd97-6171-4067-b753-ebf522c5abf3 not found, creating... [ 1057.591018] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.591198] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.591839] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.591839] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.591839] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.592147] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.592337] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.592488] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.592888] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.592888] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.593017] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Resource: SegmentPort with ID: f074bd97-6171-4067-b753-ebf522c5abf3 is going to be created. [ 1057.615838] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.616720] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.616720] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.616720] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.616912] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.617226] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "port-f074bd97-6171-4067-b753-ebf522c5abf3" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.030423] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f2738afc-1df7-4958-9efd-71a6bbe54e6e: rpc.has_security_group_logging(os_id): False [ 1058.054827] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.055062] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.055147] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.055363] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.055459] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.055699] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.055805] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.055870] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.056054] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.056159] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.056318] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.056415] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.056471] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.056618] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.056696] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.056884] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.056980] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.057055] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.057204] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.057278] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.057366] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f2738afc-1df7-4958-9efd-71a6bbe54e6e is going to be created. [ 1058.115583] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 56904b3c-38e4-4547-9a1d-cc787c3fef9d in Status: SUCCESS [ 1058.115731] env[65306]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 56904b3c-38e4-4547-9a1d-cc787c3fef9d deletion is rescheduled due to dependency. [ 1058.115779] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-56904b3c-38e4-4547-9a1d-cc787c3fef9d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.151734] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.151734] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.151734] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.152057] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.152057] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.164893] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f2738afc-1df7-4958-9efd-71a6bbe54e6e in Status: IN_PROGRESS for 2s [ 1058.455358] env[65306]: INFO networking_nsxv3.common.synchronization [req-1c567f29-3ef9-443b-bd70-a6b3bfa4bd73 req-e8358957-ac3b-4057-8fa9-6ea75b314927 service nova] Enqueued Resource ID: 57bb6fe9-98c4-47f0-9daa-c424a0c9dfee with Priority: HIGHEST for action security_group_rules [ 1058.455358] env[65306]: INFO networking_nsxv3.common.synchronization [req-1c567f29-3ef9-443b-bd70-a6b3bfa4bd73 req-e8358957-ac3b-4057-8fa9-6ea75b314927 service nova] Enqueued Resource ID: 57bb6fe9-98c4-47f0-9daa-c424a0c9dfee with Priority: HIGHEST for action security_group_members [ 1058.455551] env[65306]: INFO networking_nsxv3.common.synchronization [req-1c567f29-3ef9-443b-bd70-a6b3bfa4bd73 req-e8358957-ac3b-4057-8fa9-6ea75b314927 service nova] Enqueued Resource ID: f074bd97-6171-4067-b753-ebf522c5abf3 with Priority: HIGHEST for action port [ 1058.456142] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 57bb6fe9-98c4-47f0-9daa-c424a0c9dfee with Priority: HIGHEST for action security_group_rules [ 1058.456320] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 57bb6fe9-98c4-47f0-9daa-c424a0c9dfee with Priority: HIGHEST for action security_group_members [ 1058.456453] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f074bd97-6171-4067-b753-ebf522c5abf3 with Priority: HIGHEST for action port [ 1058.456802] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock rules-57bb6fe9-98c4-47f0-9daa-c424a0c9dfee taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.456959] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-57bb6fe9-98c4-47f0-9daa-c424a0c9dfee" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.457081] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-57bb6fe9-98c4-47f0-9daa-c424a0c9dfee" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.457337] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-57bb6fe9-98c4-47f0-9daa-c424a0c9dfee" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.457424] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('57bb6fe9-98c4-47f0-9daa-c424a0c9dfee',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1058.459150] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-57bb6fe9-98c4-47f0-9daa-c424a0c9dfee taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.459278] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-57bb6fe9-98c4-47f0-9daa-c424a0c9dfee" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.459349] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-57bb6fe9-98c4-47f0-9daa-c424a0c9dfee" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.459565] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-57bb6fe9-98c4-47f0-9daa-c424a0c9dfee" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.459700] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.459797] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.459868] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.460754] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.460999] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.460999] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('57bb6fe9-98c4-47f0-9daa-c424a0c9dfee',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1058.462264] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock port-f074bd97-6171-4067-b753-ebf522c5abf3 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.462264] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f074bd97-6171-4067-b753-ebf522c5abf3" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.462264] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f074bd97-6171-4067-b753-ebf522c5abf3" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.462264] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f074bd97-6171-4067-b753-ebf522c5abf3" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.462947] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f074bd97-6171-4067-b753-ebf522c5abf3',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1058.655990] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0cb41b0f-cdd2-4222-95b4-bafd614b7460 in Status: SUCCESS [ 1058.655990] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0cb41b0f-cdd2-4222-95b4-bafd614b7460" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.936860] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d in Status: SUCCESS [ 1058.936860] env[65306]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d deletion is rescheduled due to dependency. [ 1058.936860] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.965854] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('57bb6fe9-98c4-47f0-9daa-c424a0c9dfee',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1058.965854] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-57bb6fe9-98c4-47f0-9daa-c424a0c9dfee taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.965854] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-57bb6fe9-98c4-47f0-9daa-c424a0c9dfee" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.969714] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f074bd97-6171-4067-b753-ebf522c5abf3 with status ACTIVE [ 1058.969714] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.969714] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.969714] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.969714] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.969714] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.969714] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.970060] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.970060] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.970060] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.970172] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.970258] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.970342] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.970414] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.970530] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.970607] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.971039] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f074bd97-6171-4067-b753-ebf522c5abf3 is going to be updated. [ 1058.995077] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.995077] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.995077] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.995077] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.995077] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.995349] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f074bd97-6171-4067-b753-ebf522c5abf3" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.469631] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('57bb6fe9-98c4-47f0-9daa-c424a0c9dfee',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1059.973185] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.973417] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.973515] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.973747] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.974443] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.974443] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 57bb6fe9-98c4-47f0-9daa-c424a0c9dfee is going to be created. [ 1060.007841] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.008009] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.008092] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.008386] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.008480] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.023292] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 57bb6fe9-98c4-47f0-9daa-c424a0c9dfee in Status: UNINITIALIZED for 2s [ 1060.179463] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f2738afc-1df7-4958-9efd-71a6bbe54e6e in Status: SUCCESS [ 1060.179723] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f2738afc-1df7-4958-9efd-71a6bbe54e6e" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.362983] env[65306]: INFO networking_nsxv3.common.synchronization [req-ecffaf5f-0845-4ed7-b547-c13116ea25df req-dfd6a6b0-7dd9-4dfb-9451-2ccb33576b53 tempest-ImagesNegativeTestJSON-703159048 tempest-ImagesNegativeTestJSON-703159048-project-member] Enqueued Resource ID: 17a26b80-c2ff-49b2-a30b-bd2b600f8787 with Priority: HIGHEST for action security_group_members [ 1060.364055] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 17a26b80-c2ff-49b2-a30b-bd2b600f8787 with Priority: HIGHEST for action security_group_members [ 1060.364055] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-17a26b80-c2ff-49b2-a30b-bd2b600f8787 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.364261] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-17a26b80-c2ff-49b2-a30b-bd2b600f8787" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.364380] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-17a26b80-c2ff-49b2-a30b-bd2b600f8787" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.364657] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-17a26b80-c2ff-49b2-a30b-bd2b600f8787" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.364970] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.365103] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.365202] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.365451] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.365655] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.365703] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('17a26b80-c2ff-49b2-a30b-bd2b600f8787',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1060.834689] env[65306]: INFO networking_nsxv3.common.synchronization [req-61e9c950-2144-450e-906c-78fd28ebde17 req-49f6151d-4662-4436-807d-1d5648d4e254 tempest-AttachInterfacesTestJSON-144464476 tempest-AttachInterfacesTestJSON-144464476-project-member] Enqueued Resource ID: 50a889c1-6336-4320-94ea-df1e6eaa778c with Priority: HIGHEST for action security_group_members [ 1060.835605] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 50a889c1-6336-4320-94ea-df1e6eaa778c with Priority: HIGHEST for action security_group_members [ 1060.835605] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-50a889c1-6336-4320-94ea-df1e6eaa778c taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.835854] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-50a889c1-6336-4320-94ea-df1e6eaa778c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.835854] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-50a889c1-6336-4320-94ea-df1e6eaa778c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.836102] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-50a889c1-6336-4320-94ea-df1e6eaa778c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.836280] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.836398] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.836476] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.836650] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.836755] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.836865] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('50a889c1-6336-4320-94ea-df1e6eaa778c',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1060.869557] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.869731] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.869778] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.869982] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.870077] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.870271] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.870368] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.870431] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.870582] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.870657] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.870745] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 17a26b80-c2ff-49b2-a30b-bd2b600f8787 is going to be updated. [ 1060.908749] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.909220] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.909466] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.909751] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.909989] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.920351] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 17a26b80-c2ff-49b2-a30b-bd2b600f8787 in Status: IN_PROGRESS for 2s [ 1061.339196] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.339444] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.339536] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.340185] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.340185] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.340698] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.340698] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.340698] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.340698] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.341461] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.341461] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 50a889c1-6336-4320-94ea-df1e6eaa778c is going to be updated. [ 1061.380936] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.380936] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.381143] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.381318] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.381469] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.392617] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 50a889c1-6336-4320-94ea-df1e6eaa778c in Status: IN_PROGRESS for 2s [ 1062.035245] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 57bb6fe9-98c4-47f0-9daa-c424a0c9dfee in Status: SUCCESS [ 1062.035245] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-57bb6fe9-98c4-47f0-9daa-c424a0c9dfee" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.035245] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-57bb6fe9-98c4-47f0-9daa-c424a0c9dfee" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.035245] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-57bb6fe9-98c4-47f0-9daa-c424a0c9dfee" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.039283] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.039283] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.039283] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.039283] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.039283] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.039283] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-57bb6fe9-98c4-47f0-9daa-c424a0c9dfee" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.039283] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('57bb6fe9-98c4-47f0-9daa-c424a0c9dfee',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1062.539513] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-57bb6fe9-98c4-47f0-9daa-c424a0c9dfee taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.539928] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-57bb6fe9-98c4-47f0-9daa-c424a0c9dfee" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.540301] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-57bb6fe9-98c4-47f0-9daa-c424a0c9dfee" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.540578] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-57bb6fe9-98c4-47f0-9daa-c424a0c9dfee" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.540793] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.540918] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.540979] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.541145] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.541234] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.541324] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-57bb6fe9-98c4-47f0-9daa-c424a0c9dfee" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.541479] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-57bb6fe9-98c4-47f0-9daa-c424a0c9dfee taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.541573] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-57bb6fe9-98c4-47f0-9daa-c424a0c9dfee" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.541642] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-57bb6fe9-98c4-47f0-9daa-c424a0c9dfee" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.541769] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-57bb6fe9-98c4-47f0-9daa-c424a0c9dfee" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.541903] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.541993] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.542072] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.542197] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.542271] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.542351] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-57bb6fe9-98c4-47f0-9daa-c424a0c9dfee" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.542477] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('57bb6fe9-98c4-47f0-9daa-c424a0c9dfee',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1062.931702] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 17a26b80-c2ff-49b2-a30b-bd2b600f8787 in Status: SUCCESS [ 1062.931702] env[65306]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 17a26b80-c2ff-49b2-a30b-bd2b600f8787 deletion is rescheduled due to dependency. [ 1062.931702] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-17a26b80-c2ff-49b2-a30b-bd2b600f8787" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.046403] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 57bb6fe9-98c4-47f0-9daa-c424a0c9dfee: rpc.has_security_group_logging(os_id): False [ 1063.066770] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.066919] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.066984] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.067212] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.067301] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.067514] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.067614] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.067679] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.067860] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.067926] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.068131] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.068227] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.068281] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.068422] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.068494] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.068682] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.068788] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.068840] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.068966] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.069060] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.069151] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 57bb6fe9-98c4-47f0-9daa-c424a0c9dfee is going to be created. [ 1063.132974] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.133204] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.133204] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.133393] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.133624] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.151199] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 57bb6fe9-98c4-47f0-9daa-c424a0c9dfee in Status: IN_PROGRESS for 2s [ 1063.405360] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 50a889c1-6336-4320-94ea-df1e6eaa778c in Status: SUCCESS [ 1063.405504] env[65306]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 50a889c1-6336-4320-94ea-df1e6eaa778c deletion is rescheduled due to dependency. [ 1063.405554] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-50a889c1-6336-4320-94ea-df1e6eaa778c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.169318] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 57bb6fe9-98c4-47f0-9daa-c424a0c9dfee in Status: SUCCESS [ 1065.169592] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-57bb6fe9-98c4-47f0-9daa-c424a0c9dfee" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.221440] env[65306]: INFO networking_nsxv3.common.synchronization [req-da787816-c044-4a0c-974c-ef975a79e13c req-5ed26223-554d-42fc-a36d-0d74b3df0abe tempest-ServerGroupTestJSON-642980956 tempest-ServerGroupTestJSON-642980956-project-member] Enqueued Resource ID: f2738afc-1df7-4958-9efd-71a6bbe54e6e with Priority: HIGHEST for action security_group_members [ 1065.222694] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f2738afc-1df7-4958-9efd-71a6bbe54e6e with Priority: HIGHEST for action security_group_members [ 1065.222694] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-f2738afc-1df7-4958-9efd-71a6bbe54e6e taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.222694] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f2738afc-1df7-4958-9efd-71a6bbe54e6e" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.222694] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f2738afc-1df7-4958-9efd-71a6bbe54e6e" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.222902] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f2738afc-1df7-4958-9efd-71a6bbe54e6e" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.222943] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.223033] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.223148] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.223505] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.223505] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.223505] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f2738afc-1df7-4958-9efd-71a6bbe54e6e',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1065.729029] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.729257] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.729345] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.729612] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.729804] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.730053] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.730216] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.730318] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.730686] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.730815] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.730999] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f2738afc-1df7-4958-9efd-71a6bbe54e6e is going to be updated. [ 1065.776124] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.776357] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.776452] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.776941] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.777152] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.791800] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f2738afc-1df7-4958-9efd-71a6bbe54e6e in Status: IN_PROGRESS for 2s [ 1067.804581] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f2738afc-1df7-4958-9efd-71a6bbe54e6e in Status: SUCCESS [ 1067.804954] env[65306]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f2738afc-1df7-4958-9efd-71a6bbe54e6e deletion is rescheduled due to dependency. [ 1067.804954] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f2738afc-1df7-4958-9efd-71a6bbe54e6e" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.500019] env[65306]: INFO networking_nsxv3.common.synchronization [req-82ab24d8-e13c-49e1-9cb0-003acd99010f req-5f64fb80-c1c4-4377-a2f5-fa510072e8e1 tempest-ServerActionsTestJSON-437813836 tempest-ServerActionsTestJSON-437813836-project-member] Enqueued Resource ID: 6e403189-fcac-40e3-aa50-4c17f4d29895 with Priority: HIGHEST for action security_group_members [ 1069.500019] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6e403189-fcac-40e3-aa50-4c17f4d29895 with Priority: HIGHEST for action security_group_members [ 1069.500019] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-6e403189-fcac-40e3-aa50-4c17f4d29895 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.500019] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6e403189-fcac-40e3-aa50-4c17f4d29895" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.500530] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6e403189-fcac-40e3-aa50-4c17f4d29895" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.500530] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6e403189-fcac-40e3-aa50-4c17f4d29895" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.500530] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.500530] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.500767] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.500767] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.500831] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.500876] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6e403189-fcac-40e3-aa50-4c17f4d29895',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1070.002843] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.003059] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.003134] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.003383] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.030360] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.030637] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.030781] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.030857] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.031038] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.031124] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.031232] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6e403189-fcac-40e3-aa50-4c17f4d29895 is going to be updated. [ 1070.080954] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.081176] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.081300] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.081584] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.081788] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.092286] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6e403189-fcac-40e3-aa50-4c17f4d29895 in Status: IN_PROGRESS for 2s [ 1072.107640] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6e403189-fcac-40e3-aa50-4c17f4d29895 in Status: SUCCESS [ 1072.107919] env[65306]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6e403189-fcac-40e3-aa50-4c17f4d29895 deletion is rescheduled due to dependency. [ 1072.107973] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6e403189-fcac-40e3-aa50-4c17f4d29895" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.997837] env[65306]: INFO networking_nsxv3.common.synchronization [req-79067316-38a3-4db2-ad2b-8975a250faec req-6e16c826-8824-4f4c-b090-92393adb8659 tempest-AttachVolumeNegativeTest-723798471 tempest-AttachVolumeNegativeTest-723798471-project-member] Enqueued Resource ID: 7f22d913-90d3-4ccb-8780-b9dbc479a7d3 with Priority: HIGHEST for action security_group_members [ 1072.998420] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7f22d913-90d3-4ccb-8780-b9dbc479a7d3 with Priority: HIGHEST for action security_group_members [ 1072.998665] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-7f22d913-90d3-4ccb-8780-b9dbc479a7d3 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.998808] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7f22d913-90d3-4ccb-8780-b9dbc479a7d3" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.998853] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7f22d913-90d3-4ccb-8780-b9dbc479a7d3" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.999101] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7f22d913-90d3-4ccb-8780-b9dbc479a7d3" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.999220] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.999323] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.999386] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.999711] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.999711] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.999711] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7f22d913-90d3-4ccb-8780-b9dbc479a7d3',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1073.503593] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.503916] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.503916] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.504230] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.527149] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.527479] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.527633] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.527710] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.527912] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.527999] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.528118] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7f22d913-90d3-4ccb-8780-b9dbc479a7d3 is going to be updated. [ 1073.562203] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.562351] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.562423] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.562656] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.563598] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.574618] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7f22d913-90d3-4ccb-8780-b9dbc479a7d3 in Status: IN_PROGRESS for 2s [ 1073.816780] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock network-715 taken with stack trace [, , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.816991] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "network-715" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.817133] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "network-715" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.817408] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "network-715" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.817658] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.817815] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.817930] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.820476] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.820648] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.820897] env[65306]: DEBUG dogpile.cache.region [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] No value present for key: 'zone-id' {{(pid=65306) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1073.821023] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] NeedRegenerationException {{(pid=65306) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1073.821137] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] no value, waiting for create lock {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1073.821244] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] value creation lock acquired {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1073.821368] env[65306]: DEBUG dogpile.cache.region [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] No value present for key: 'zone-id' {{(pid=65306) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1073.821448] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Calling creation function for not-yet-present value {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1073.821588] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1073.842442] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1073.842626] env[65306]: DEBUG dogpile.cache.region [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65306) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1073.842830] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Released creation lock {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1073.844472] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "network-715" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.844472] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock port-6a4d5c10-35bc-48db-b46a-7c1816acd7b5 taken with stack trace [, , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.844472] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "port-6a4d5c10-35bc-48db-b46a-7c1816acd7b5" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.844472] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "port-6a4d5c10-35bc-48db-b46a-7c1816acd7b5" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.844472] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "port-6a4d5c10-35bc-48db-b46a-7c1816acd7b5" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.844472] env[65306]: DEBUG networking_nsxv3.api.rpc [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6a4d5c10-35bc-48db-b46a-7c1816acd7b5',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1074.347741] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.347995] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.348144] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.348512] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.348597] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.348860] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.349025] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.349140] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.349360] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.349538] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.350694] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.350908] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.351402] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.351550] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.351949] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.351949] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Resource: SegmentPort with ID: 6a4d5c10-35bc-48db-b46a-7c1816acd7b5 is going to be updated. [ 1074.389870] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.390228] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.390228] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.390514] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.390731] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.391113] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "port-6a4d5c10-35bc-48db-b46a-7c1816acd7b5" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.086202] env[65306]: INFO networking_nsxv3.common.synchronization [req-3f89df1f-c8df-4b92-945b-184a180d181b req-5e57f0fb-84dd-477e-b40a-d07e0bfc9912 service nova] Enqueued Resource ID: 7c868cfd-e55d-4976-95db-5b3f64c76a5f with Priority: HIGHEST for action security_group_rules [ 1075.086493] env[65306]: INFO networking_nsxv3.common.synchronization [req-3f89df1f-c8df-4b92-945b-184a180d181b req-5e57f0fb-84dd-477e-b40a-d07e0bfc9912 service nova] Enqueued Resource ID: 7c868cfd-e55d-4976-95db-5b3f64c76a5f with Priority: HIGHEST for action security_group_members [ 1075.086601] env[65306]: INFO networking_nsxv3.common.synchronization [req-3f89df1f-c8df-4b92-945b-184a180d181b req-5e57f0fb-84dd-477e-b40a-d07e0bfc9912 service nova] Enqueued Resource ID: 6a4d5c10-35bc-48db-b46a-7c1816acd7b5 with Priority: HIGHEST for action port [ 1075.087251] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7c868cfd-e55d-4976-95db-5b3f64c76a5f with Priority: HIGHEST for action security_group_rules [ 1075.088204] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7c868cfd-e55d-4976-95db-5b3f64c76a5f with Priority: HIGHEST for action security_group_members [ 1075.088204] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6a4d5c10-35bc-48db-b46a-7c1816acd7b5 with Priority: HIGHEST for action port [ 1075.088204] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7c868cfd-e55d-4976-95db-5b3f64c76a5f taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.088204] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7c868cfd-e55d-4976-95db-5b3f64c76a5f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.088204] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7c868cfd-e55d-4976-95db-5b3f64c76a5f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.088392] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7c868cfd-e55d-4976-95db-5b3f64c76a5f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.088429] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7c868cfd-e55d-4976-95db-5b3f64c76a5f',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1075.089348] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-7c868cfd-e55d-4976-95db-5b3f64c76a5f taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.089495] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7c868cfd-e55d-4976-95db-5b3f64c76a5f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.089562] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7c868cfd-e55d-4976-95db-5b3f64c76a5f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.089778] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7c868cfd-e55d-4976-95db-5b3f64c76a5f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.089946] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.090068] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.090216] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.090439] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.090439] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.090736] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7c868cfd-e55d-4976-95db-5b3f64c76a5f',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1075.091408] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock port-6a4d5c10-35bc-48db-b46a-7c1816acd7b5 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.091553] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6a4d5c10-35bc-48db-b46a-7c1816acd7b5" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.091651] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6a4d5c10-35bc-48db-b46a-7c1816acd7b5" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.091801] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6a4d5c10-35bc-48db-b46a-7c1816acd7b5" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.091893] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6a4d5c10-35bc-48db-b46a-7c1816acd7b5',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1075.584749] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7f22d913-90d3-4ccb-8780-b9dbc479a7d3 in Status: SUCCESS [ 1075.584932] env[65306]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7f22d913-90d3-4ccb-8780-b9dbc479a7d3 deletion is rescheduled due to dependency. [ 1075.585082] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7f22d913-90d3-4ccb-8780-b9dbc479a7d3" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.593540] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7c868cfd-e55d-4976-95db-5b3f64c76a5f',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1075.597846] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-7c868cfd-e55d-4976-95db-5b3f64c76a5f taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.597951] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7c868cfd-e55d-4976-95db-5b3f64c76a5f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.598160] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6a4d5c10-35bc-48db-b46a-7c1816acd7b5 with status ACTIVE [ 1075.598380] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.598463] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.598463] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.598670] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.598779] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.599012] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.599118] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.599181] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.599341] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.599426] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.599610] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.599702] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.599763] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.599900] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.599974] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.600068] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6a4d5c10-35bc-48db-b46a-7c1816acd7b5 is going to be updated. [ 1075.635691] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.635691] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.635691] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.636032] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.636278] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.636518] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6a4d5c10-35bc-48db-b46a-7c1816acd7b5" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.102390] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7c868cfd-e55d-4976-95db-5b3f64c76a5f',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1076.605891] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.608468] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.608468] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.608468] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.608468] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.608468] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7c868cfd-e55d-4976-95db-5b3f64c76a5f is going to be updated. [ 1076.640377] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.641466] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.641557] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.642049] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.642194] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.652089] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7c868cfd-e55d-4976-95db-5b3f64c76a5f in Status: IN_PROGRESS for 2s [ 1077.415836] env[65306]: INFO networking_nsxv3.common.synchronization [None req-93b3618d-480b-4369-886f-823144955951 None None] Enqueued Resource ID: 33c07872-6257-4965-9c55-b4616d155d14 with Priority: HIGHEST for action port [ 1077.416288] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 33c07872-6257-4965-9c55-b4616d155d14 with Priority: HIGHEST for action port [ 1077.416534] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock port-33c07872-6257-4965-9c55-b4616d155d14 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.416695] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-33c07872-6257-4965-9c55-b4616d155d14" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.416778] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-33c07872-6257-4965-9c55-b4616d155d14" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.417069] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-33c07872-6257-4965-9c55-b4616d155d14" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.417636] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('33c07872-6257-4965-9c55-b4616d155d14',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1077.921364] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 33c07872-6257-4965-9c55-b4616d155d14 [ 1077.921364] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.921364] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.921364] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.921364] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.921364] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.921364] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:33c07872-6257-4965-9c55-b4616d155d14 already deleted. [ 1077.921364] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-33c07872-6257-4965-9c55-b4616d155d14" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.664719] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7c868cfd-e55d-4976-95db-5b3f64c76a5f in Status: SUCCESS [ 1078.664951] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7c868cfd-e55d-4976-95db-5b3f64c76a5f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.665132] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7c868cfd-e55d-4976-95db-5b3f64c76a5f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.665351] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7c868cfd-e55d-4976-95db-5b3f64c76a5f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.665540] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.665677] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.665751] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.665911] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.665989] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.666089] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7c868cfd-e55d-4976-95db-5b3f64c76a5f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.666237] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7c868cfd-e55d-4976-95db-5b3f64c76a5f',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1079.168460] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-7c868cfd-e55d-4976-95db-5b3f64c76a5f taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.168610] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7c868cfd-e55d-4976-95db-5b3f64c76a5f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.168691] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7c868cfd-e55d-4976-95db-5b3f64c76a5f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.169224] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7c868cfd-e55d-4976-95db-5b3f64c76a5f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.169773] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.169886] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.169937] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.170120] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.170214] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.170304] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7c868cfd-e55d-4976-95db-5b3f64c76a5f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.170538] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-7c868cfd-e55d-4976-95db-5b3f64c76a5f taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.170697] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7c868cfd-e55d-4976-95db-5b3f64c76a5f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.170697] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7c868cfd-e55d-4976-95db-5b3f64c76a5f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.170749] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7c868cfd-e55d-4976-95db-5b3f64c76a5f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.170932] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.170993] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.171054] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.171195] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.171269] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.171354] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7c868cfd-e55d-4976-95db-5b3f64c76a5f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.171443] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7c868cfd-e55d-4976-95db-5b3f64c76a5f',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1079.676433] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7c868cfd-e55d-4976-95db-5b3f64c76a5f: rpc.has_security_group_logging(os_id): False [ 1079.696806] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.699017] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.699017] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.699017] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.718128] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.718128] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.718128] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.718128] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.718337] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.718337] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.718534] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.718684] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.718684] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.718873] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.718976] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.719251] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.719358] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.719457] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.719623] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.719758] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.719859] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7c868cfd-e55d-4976-95db-5b3f64c76a5f is going to be updated. [ 1079.803312] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.803418] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.803561] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.803697] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.803880] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.819016] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7c868cfd-e55d-4976-95db-5b3f64c76a5f in Status: IN_PROGRESS for 2s [ 1080.176391] env[65306]: INFO networking_nsxv3.common.synchronization [None req-3e992c10-6839-4126-9224-e1acfd679ae7 None None] Enqueued Resource ID: 77b5792d-18d1-4e35-8019-cc03ffeea5a8 with Priority: HIGHEST for action port [ 1080.176968] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 77b5792d-18d1-4e35-8019-cc03ffeea5a8 with Priority: HIGHEST for action port [ 1080.177300] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock port-77b5792d-18d1-4e35-8019-cc03ffeea5a8 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.177419] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-77b5792d-18d1-4e35-8019-cc03ffeea5a8" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.177490] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-77b5792d-18d1-4e35-8019-cc03ffeea5a8" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.177754] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-77b5792d-18d1-4e35-8019-cc03ffeea5a8" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.177836] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('77b5792d-18d1-4e35-8019-cc03ffeea5a8',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1080.680929] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 77b5792d-18d1-4e35-8019-cc03ffeea5a8 [ 1080.681222] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.681369] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.681439] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.681652] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.681765] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.681905] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:77b5792d-18d1-4e35-8019-cc03ffeea5a8 already deleted. [ 1080.682014] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-77b5792d-18d1-4e35-8019-cc03ffeea5a8" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.820520] env[65306]: INFO networking_nsxv3.common.synchronization [req-852ff8d4-eaf6-4578-abb2-20c51aed4cdc req-acb17f92-ed3e-403d-8987-78615c15a1ce tempest-ImagesTestJSON-762064805 tempest-ImagesTestJSON-762064805-project-member] Enqueued Resource ID: 57bb6fe9-98c4-47f0-9daa-c424a0c9dfee with Priority: HIGHEST for action security_group_members [ 1080.821035] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 57bb6fe9-98c4-47f0-9daa-c424a0c9dfee with Priority: HIGHEST for action security_group_members [ 1080.821357] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-57bb6fe9-98c4-47f0-9daa-c424a0c9dfee taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.821515] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-57bb6fe9-98c4-47f0-9daa-c424a0c9dfee" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.821592] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-57bb6fe9-98c4-47f0-9daa-c424a0c9dfee" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.821776] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-57bb6fe9-98c4-47f0-9daa-c424a0c9dfee" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.822017] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.822163] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.822465] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.822465] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.822593] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.822684] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('57bb6fe9-98c4-47f0-9daa-c424a0c9dfee',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1081.327082] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.327082] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.327082] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.327322] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.327418] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.327682] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.327784] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.327857] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.328079] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.328176] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.328285] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 57bb6fe9-98c4-47f0-9daa-c424a0c9dfee is going to be updated. [ 1081.363458] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.363648] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.363648] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.364291] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.364291] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.373719] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 57bb6fe9-98c4-47f0-9daa-c424a0c9dfee in Status: IN_PROGRESS for 2s [ 1081.836525] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7c868cfd-e55d-4976-95db-5b3f64c76a5f in Status: SUCCESS [ 1081.836525] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7c868cfd-e55d-4976-95db-5b3f64c76a5f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.387705] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 57bb6fe9-98c4-47f0-9daa-c424a0c9dfee in Status: SUCCESS [ 1083.387990] env[65306]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 57bb6fe9-98c4-47f0-9daa-c424a0c9dfee deletion is rescheduled due to dependency. [ 1083.388034] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-57bb6fe9-98c4-47f0-9daa-c424a0c9dfee" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.669792] env[65306]: INFO networking_nsxv3.common.synchronization [req-143a1890-f03c-495c-934d-a093f9d1a055 req-d424c81a-b655-4d6e-b06a-8d72ef5b42ad tempest-ServersTestJSON-1773114292 tempest-ServersTestJSON-1773114292-project-member] Enqueued Resource ID: 0cb41b0f-cdd2-4222-95b4-bafd614b7460 with Priority: HIGHEST for action security_group_members [ 1083.670378] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0cb41b0f-cdd2-4222-95b4-bafd614b7460 with Priority: HIGHEST for action security_group_members [ 1083.670746] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-0cb41b0f-cdd2-4222-95b4-bafd614b7460 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.670898] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0cb41b0f-cdd2-4222-95b4-bafd614b7460" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.670898] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0cb41b0f-cdd2-4222-95b4-bafd614b7460" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.671197] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0cb41b0f-cdd2-4222-95b4-bafd614b7460" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.671413] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.671548] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.671643] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.671842] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.671971] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.672109] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0cb41b0f-cdd2-4222-95b4-bafd614b7460',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1083.979114] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock network-949 taken with stack trace [, , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.979401] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "network-949" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.979558] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "network-949" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.979843] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "network-949" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.980135] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.980311] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.980430] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.980660] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.980855] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.981075] env[65306]: DEBUG dogpile.cache.region [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] No value present for key: 'zone-id' {{(pid=65306) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1083.981188] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] NeedRegenerationException {{(pid=65306) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1083.981314] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] no value, waiting for create lock {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1083.981416] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] value creation lock acquired {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1083.981542] env[65306]: DEBUG dogpile.cache.region [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] No value present for key: 'zone-id' {{(pid=65306) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1083.981649] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Calling creation function for not-yet-present value {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1083.981799] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1084.001431] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1084.001553] env[65306]: DEBUG dogpile.cache.region [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65306) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1084.001675] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Released creation lock {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1084.001805] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "network-949" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.002125] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock port-dd30b601-e66c-460b-b46c-f2f002b29139 taken with stack trace [, , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.002291] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "port-dd30b601-e66c-460b-b46c-f2f002b29139" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.002411] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "port-dd30b601-e66c-460b-b46c-f2f002b29139" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.002728] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "port-dd30b601-e66c-460b-b46c-f2f002b29139" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.002912] env[65306]: DEBUG networking_nsxv3.api.rpc [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dd30b601-e66c-460b-b46c-f2f002b29139',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1084.174624] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0cb41b0f-cdd2-4222-95b4-bafd614b7460',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1084.505744] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.506056] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.506129] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.506404] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.506558] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.506716] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Segment Port dd30b601-e66c-460b-b46c-f2f002b29139 not found, creating... [ 1084.506977] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.507152] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.507269] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.507524] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.507709] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.508012] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.508188] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.508310] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.508521] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.508671] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.508845] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Resource: SegmentPort with ID: dd30b601-e66c-460b-b46c-f2f002b29139 is going to be created. [ 1084.531158] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.531391] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.531524] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.531806] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.532049] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.532282] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "port-dd30b601-e66c-460b-b46c-f2f002b29139" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.676677] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0cb41b0f-cdd2-4222-95b4-bafd614b7460',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1085.179172] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.179399] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.179399] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.179635] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.179726] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.179831] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0cb41b0f-cdd2-4222-95b4-bafd614b7460 is going to be updated. [ 1085.220669] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.220872] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.220930] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.221155] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.221304] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.234485] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0cb41b0f-cdd2-4222-95b4-bafd614b7460 in Status: IN_PROGRESS for 2s [ 1085.752184] env[65306]: INFO networking_nsxv3.common.synchronization [req-143a1890-f03c-495c-934d-a093f9d1a055 req-9afe8ad3-223a-49a3-8642-95a339dd26e5 service nova] Enqueued Resource ID: 0cb41b0f-cdd2-4222-95b4-bafd614b7460 with Priority: HIGHEST for action security_group_rules [ 1085.752184] env[65306]: INFO networking_nsxv3.common.synchronization [req-143a1890-f03c-495c-934d-a093f9d1a055 req-9afe8ad3-223a-49a3-8642-95a339dd26e5 service nova] Enqueued Resource ID: 0cb41b0f-cdd2-4222-95b4-bafd614b7460 with Priority: HIGHEST for action security_group_members [ 1085.752184] env[65306]: INFO networking_nsxv3.common.synchronization [req-143a1890-f03c-495c-934d-a093f9d1a055 req-9afe8ad3-223a-49a3-8642-95a339dd26e5 service nova] Enqueued Resource ID: dd30b601-e66c-460b-b46c-f2f002b29139 with Priority: HIGHEST for action port [ 1085.752766] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0cb41b0f-cdd2-4222-95b4-bafd614b7460 with Priority: HIGHEST for action security_group_rules [ 1085.753023] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0cb41b0f-cdd2-4222-95b4-bafd614b7460 with Priority: HIGHEST for action security_group_members [ 1085.753177] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dd30b601-e66c-460b-b46c-f2f002b29139 with Priority: HIGHEST for action port [ 1085.754048] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0cb41b0f-cdd2-4222-95b4-bafd614b7460 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.754048] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0cb41b0f-cdd2-4222-95b4-bafd614b7460" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.754048] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0cb41b0f-cdd2-4222-95b4-bafd614b7460" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.754048] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0cb41b0f-cdd2-4222-95b4-bafd614b7460" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.754048] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0cb41b0f-cdd2-4222-95b4-bafd614b7460',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1085.755438] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-0cb41b0f-cdd2-4222-95b4-bafd614b7460 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.756921] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0cb41b0f-cdd2-4222-95b4-bafd614b7460" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.756921] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock port-dd30b601-e66c-460b-b46c-f2f002b29139 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.756921] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-dd30b601-e66c-460b-b46c-f2f002b29139" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.756921] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-dd30b601-e66c-460b-b46c-f2f002b29139" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.756921] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-dd30b601-e66c-460b-b46c-f2f002b29139" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.756921] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dd30b601-e66c-460b-b46c-f2f002b29139',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1086.258664] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-0cb41b0f-cdd2-4222-95b4-bafd614b7460 taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.258866] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0cb41b0f-cdd2-4222-95b4-bafd614b7460" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.259484] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port dd30b601-e66c-460b-b46c-f2f002b29139 with status ACTIVE [ 1086.259758] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.259886] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.260642] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.260642] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.260642] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.260642] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.260642] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.260642] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.261262] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.261262] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.261315] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.261542] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.261727] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.262178] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.262178] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.262245] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: dd30b601-e66c-460b-b46c-f2f002b29139 is going to be updated. [ 1086.296487] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.296678] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.296753] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.296980] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.297317] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.297433] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-dd30b601-e66c-460b-b46c-f2f002b29139" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.376429] env[65306]: INFO networking_nsxv3.common.synchronization [None req-9faaa166-0411-4c3a-ae01-f1eb9073b4b4 tempest-AttachInterfacesTestJSON-144464476 tempest-AttachInterfacesTestJSON-144464476-project-member] Enqueued Resource ID: 4603b17e-9032-4f9f-a8ac-9d7d5e34db46 with Priority: HIGHEST for action security_group_rules [ 1086.377444] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4603b17e-9032-4f9f-a8ac-9d7d5e34db46 with Priority: HIGHEST for action security_group_rules [ 1086.378047] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4603b17e-9032-4f9f-a8ac-9d7d5e34db46 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.378292] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4603b17e-9032-4f9f-a8ac-9d7d5e34db46" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.378433] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4603b17e-9032-4f9f-a8ac-9d7d5e34db46" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.378836] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4603b17e-9032-4f9f-a8ac-9d7d5e34db46" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.378995] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4603b17e-9032-4f9f-a8ac-9d7d5e34db46',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1086.466511] env[65306]: INFO networking_nsxv3.common.synchronization [None req-463da955-5037-4ea5-aa70-d23ee1b8d191 tempest-AttachInterfacesTestJSON-144464476 tempest-AttachInterfacesTestJSON-144464476-project-member] Enqueued Resource ID: 4603b17e-9032-4f9f-a8ac-9d7d5e34db46 with Priority: HIGHEST for action security_group_rules [ 1086.467126] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4603b17e-9032-4f9f-a8ac-9d7d5e34db46 with Priority: HIGHEST for action security_group_rules [ 1086.467445] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4603b17e-9032-4f9f-a8ac-9d7d5e34db46 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.467558] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4603b17e-9032-4f9f-a8ac-9d7d5e34db46" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.904220] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.904220] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.904220] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.904220] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.904220] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.904220] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4603b17e-9032-4f9f-a8ac-9d7d5e34db46 already deleted. [ 1086.904220] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4603b17e-9032-4f9f-a8ac-9d7d5e34db46" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.904220] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4603b17e-9032-4f9f-a8ac-9d7d5e34db46" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.904220] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4603b17e-9032-4f9f-a8ac-9d7d5e34db46" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.904220] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4603b17e-9032-4f9f-a8ac-9d7d5e34db46',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1087.248902] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0cb41b0f-cdd2-4222-95b4-bafd614b7460 in Status: SUCCESS [ 1087.249096] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0cb41b0f-cdd2-4222-95b4-bafd614b7460" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.249291] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0cb41b0f-cdd2-4222-95b4-bafd614b7460" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.249524] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0cb41b0f-cdd2-4222-95b4-bafd614b7460" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.249712] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.249834] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.249898] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.250087] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.250153] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.250290] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0cb41b0f-cdd2-4222-95b4-bafd614b7460',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1087.429795] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.430030] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.430030] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.430240] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.430365] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.430469] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4603b17e-9032-4f9f-a8ac-9d7d5e34db46 already deleted. [ 1087.430582] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4603b17e-9032-4f9f-a8ac-9d7d5e34db46" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.753305] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0cb41b0f-cdd2-4222-95b4-bafd614b7460',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1088.255594] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0cb41b0f-cdd2-4222-95b4-bafd614b7460',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1088.759623] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.759921] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.760084] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.760435] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.760602] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.760747] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0cb41b0f-cdd2-4222-95b4-bafd614b7460 is going to be updated. [ 1088.792727] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.792968] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.792968] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.793220] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.793480] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.803030] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0cb41b0f-cdd2-4222-95b4-bafd614b7460 in Status: IN_PROGRESS for 2s [ 1090.817127] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0cb41b0f-cdd2-4222-95b4-bafd614b7460 in Status: SUCCESS [ 1090.817427] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0cb41b0f-cdd2-4222-95b4-bafd614b7460" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.817613] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0cb41b0f-cdd2-4222-95b4-bafd614b7460" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.818110] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0cb41b0f-cdd2-4222-95b4-bafd614b7460" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.818360] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.818486] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.818558] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.818732] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.818814] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.818902] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0cb41b0f-cdd2-4222-95b4-bafd614b7460" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.818996] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0cb41b0f-cdd2-4222-95b4-bafd614b7460',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1091.321415] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-0cb41b0f-cdd2-4222-95b4-bafd614b7460 taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.321571] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0cb41b0f-cdd2-4222-95b4-bafd614b7460" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.321638] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0cb41b0f-cdd2-4222-95b4-bafd614b7460" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.321860] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0cb41b0f-cdd2-4222-95b4-bafd614b7460" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.322029] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.322125] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.322187] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.322347] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.322460] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.322556] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0cb41b0f-cdd2-4222-95b4-bafd614b7460" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.323532] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-0cb41b0f-cdd2-4222-95b4-bafd614b7460 taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.323532] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0cb41b0f-cdd2-4222-95b4-bafd614b7460" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.323532] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0cb41b0f-cdd2-4222-95b4-bafd614b7460" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.323532] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0cb41b0f-cdd2-4222-95b4-bafd614b7460" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.323532] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.323532] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.323532] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.323532] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.323532] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.324736] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0cb41b0f-cdd2-4222-95b4-bafd614b7460" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.324736] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0cb41b0f-cdd2-4222-95b4-bafd614b7460',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1091.468127] env[65306]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1091.468270] env[65306]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1091.832306] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0cb41b0f-cdd2-4222-95b4-bafd614b7460: rpc.has_security_group_logging(os_id): False [ 1091.856991] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.857092] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.857181] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.857460] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.857595] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.857835] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.857958] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.858045] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.858253] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.858367] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.858590] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.858740] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.858826] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.859020] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.859111] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.859346] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.859440] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.859506] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.859655] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.859749] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.859847] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0cb41b0f-cdd2-4222-95b4-bafd614b7460 is going to be updated. [ 1091.960773] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.961057] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.961131] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.961372] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.961532] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.977463] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0cb41b0f-cdd2-4222-95b4-bafd614b7460 in Status: IN_PROGRESS for 2s [ 1092.828187] env[65306]: INFO networking_nsxv3.common.synchronization [req-f93d9c5d-1e9b-4ff4-a82a-94a9587a466f req-87e5354d-88e6-409b-98f4-b29e6988641c tempest-DeleteServersTestJSON-1340326246 tempest-DeleteServersTestJSON-1340326246-project-member] Enqueued Resource ID: d82bad56-9830-4c7d-9763-6d8a05e0998c with Priority: HIGHEST for action security_group_members [ 1092.829984] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d82bad56-9830-4c7d-9763-6d8a05e0998c with Priority: HIGHEST for action security_group_members [ 1092.829984] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-d82bad56-9830-4c7d-9763-6d8a05e0998c taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.829984] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d82bad56-9830-4c7d-9763-6d8a05e0998c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.829984] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d82bad56-9830-4c7d-9763-6d8a05e0998c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.829984] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d82bad56-9830-4c7d-9763-6d8a05e0998c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.829984] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.829984] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.829984] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.829984] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.829984] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.829984] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d82bad56-9830-4c7d-9763-6d8a05e0998c',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1093.184995] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock network-591 taken with stack trace [, , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.185350] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "network-591" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.185350] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "network-591" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.185602] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "network-591" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.185847] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.186009] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.186132] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.186343] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.186485] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.186692] env[65306]: DEBUG dogpile.cache.region [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] No value present for key: 'zone-id' {{(pid=65306) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1093.186801] env[65306]: DEBUG dogpile.lock [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] NeedRegenerationException {{(pid=65306) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1093.186908] env[65306]: DEBUG dogpile.lock [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] no value, waiting for create lock {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1093.187022] env[65306]: DEBUG dogpile.lock [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] value creation lock acquired {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1093.187173] env[65306]: DEBUG dogpile.cache.region [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] No value present for key: 'zone-id' {{(pid=65306) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1093.187287] env[65306]: DEBUG dogpile.lock [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Calling creation function for not-yet-present value {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1093.187442] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1093.208075] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1093.208279] env[65306]: DEBUG dogpile.cache.region [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65306) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1093.208731] env[65306]: DEBUG dogpile.lock [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Released creation lock {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1093.208856] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "network-591" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.209390] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock port-149e4f6d-2d22-4cae-aa16-9ae7ee9b905f taken with stack trace [, , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.209609] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "port-149e4f6d-2d22-4cae-aa16-9ae7ee9b905f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.209738] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "port-149e4f6d-2d22-4cae-aa16-9ae7ee9b905f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.210263] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "port-149e4f6d-2d22-4cae-aa16-9ae7ee9b905f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.210474] env[65306]: DEBUG networking_nsxv3.api.rpc [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('149e4f6d-2d22-4cae-aa16-9ae7ee9b905f',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1093.332775] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.332933] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.333064] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.334258] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.334258] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.334258] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.334258] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.334258] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.334258] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.334258] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.334258] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d82bad56-9830-4c7d-9763-6d8a05e0998c is going to be updated. [ 1093.361733] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.361882] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.361950] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.362230] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.362329] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.372556] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d82bad56-9830-4c7d-9763-6d8a05e0998c in Status: IN_PROGRESS for 2s [ 1093.713921] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.714262] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.714431] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.714691] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.714846] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.715013] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Segment Port 149e4f6d-2d22-4cae-aa16-9ae7ee9b905f not found, creating... [ 1093.715341] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.715455] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.715606] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.715803] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.715943] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.716253] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.716407] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.716523] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.716738] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.716864] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.717015] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Resource: SegmentPort with ID: 149e4f6d-2d22-4cae-aa16-9ae7ee9b905f is going to be created. [ 1093.740589] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.740867] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.741019] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.741362] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.741630] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.741911] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "port-149e4f6d-2d22-4cae-aa16-9ae7ee9b905f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.991242] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0cb41b0f-cdd2-4222-95b4-bafd614b7460 in Status: SUCCESS [ 1093.991467] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0cb41b0f-cdd2-4222-95b4-bafd614b7460" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.454836] env[65306]: INFO networking_nsxv3.common.synchronization [req-f93d9c5d-1e9b-4ff4-a82a-94a9587a466f req-47f2fd5d-ea78-4510-92aa-ade65c39d7a8 service nova] Enqueued Resource ID: d82bad56-9830-4c7d-9763-6d8a05e0998c with Priority: HIGHEST for action security_group_rules [ 1094.455107] env[65306]: INFO networking_nsxv3.common.synchronization [req-f93d9c5d-1e9b-4ff4-a82a-94a9587a466f req-47f2fd5d-ea78-4510-92aa-ade65c39d7a8 service nova] Enqueued Resource ID: d82bad56-9830-4c7d-9763-6d8a05e0998c with Priority: HIGHEST for action security_group_members [ 1094.455456] env[65306]: INFO networking_nsxv3.common.synchronization [req-f93d9c5d-1e9b-4ff4-a82a-94a9587a466f req-47f2fd5d-ea78-4510-92aa-ade65c39d7a8 service nova] Enqueued Resource ID: 149e4f6d-2d22-4cae-aa16-9ae7ee9b905f with Priority: HIGHEST for action port [ 1094.456462] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d82bad56-9830-4c7d-9763-6d8a05e0998c with Priority: HIGHEST for action security_group_rules [ 1094.456612] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d82bad56-9830-4c7d-9763-6d8a05e0998c with Priority: HIGHEST for action security_group_members [ 1094.456713] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 149e4f6d-2d22-4cae-aa16-9ae7ee9b905f with Priority: HIGHEST for action port [ 1094.457009] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d82bad56-9830-4c7d-9763-6d8a05e0998c taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.457144] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d82bad56-9830-4c7d-9763-6d8a05e0998c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.457216] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d82bad56-9830-4c7d-9763-6d8a05e0998c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.457537] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d82bad56-9830-4c7d-9763-6d8a05e0998c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.457628] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d82bad56-9830-4c7d-9763-6d8a05e0998c',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1094.458969] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-d82bad56-9830-4c7d-9763-6d8a05e0998c taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.459083] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d82bad56-9830-4c7d-9763-6d8a05e0998c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.459290] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock port-149e4f6d-2d22-4cae-aa16-9ae7ee9b905f taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.461074] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-149e4f6d-2d22-4cae-aa16-9ae7ee9b905f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.461074] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-149e4f6d-2d22-4cae-aa16-9ae7ee9b905f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.461074] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-149e4f6d-2d22-4cae-aa16-9ae7ee9b905f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.461074] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('149e4f6d-2d22-4cae-aa16-9ae7ee9b905f',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1094.960620] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-d82bad56-9830-4c7d-9763-6d8a05e0998c taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.960782] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d82bad56-9830-4c7d-9763-6d8a05e0998c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.961041] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 149e4f6d-2d22-4cae-aa16-9ae7ee9b905f with status ACTIVE [ 1094.961270] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.961391] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.961471] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.961716] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.961855] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.962075] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.962182] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.962273] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.962585] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.962706] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.962862] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.962996] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.963147] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.963283] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.963365] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.963456] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 149e4f6d-2d22-4cae-aa16-9ae7ee9b905f is going to be updated. [ 1095.011851] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.012010] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.012089] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.012302] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.012443] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.012614] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-149e4f6d-2d22-4cae-aa16-9ae7ee9b905f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.382209] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d82bad56-9830-4c7d-9763-6d8a05e0998c in Status: SUCCESS [ 1095.382209] env[65306]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d82bad56-9830-4c7d-9763-6d8a05e0998c deletion is rescheduled due to dependency. [ 1095.382344] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d82bad56-9830-4c7d-9763-6d8a05e0998c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.382480] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d82bad56-9830-4c7d-9763-6d8a05e0998c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.382689] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d82bad56-9830-4c7d-9763-6d8a05e0998c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.382878] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.383015] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.383152] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.383311] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.383412] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.383509] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d82bad56-9830-4c7d-9763-6d8a05e0998c',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1095.842084] env[65306]: INFO networking_nsxv3.common.synchronization [req-cd8f6645-8908-4bc5-99c1-a6a8495e5034 req-b5729c75-90f4-4c37-a2aa-0f1942fa881a tempest-ServersTestJSON-1773114292 tempest-ServersTestJSON-1773114292-project-member] Enqueued Resource ID: 0cb41b0f-cdd2-4222-95b4-bafd614b7460 with Priority: HIGHEST for action security_group_members [ 1095.842897] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0cb41b0f-cdd2-4222-95b4-bafd614b7460 with Priority: HIGHEST for action security_group_members [ 1095.842897] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-0cb41b0f-cdd2-4222-95b4-bafd614b7460 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.842897] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0cb41b0f-cdd2-4222-95b4-bafd614b7460" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.843146] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0cb41b0f-cdd2-4222-95b4-bafd614b7460" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.843407] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0cb41b0f-cdd2-4222-95b4-bafd614b7460" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.843521] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.843621] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.843696] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.844323] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.844323] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.844323] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0cb41b0f-cdd2-4222-95b4-bafd614b7460',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1095.886188] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d82bad56-9830-4c7d-9763-6d8a05e0998c',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1096.346497] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0cb41b0f-cdd2-4222-95b4-bafd614b7460',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1096.392423] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d82bad56-9830-4c7d-9763-6d8a05e0998c',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1096.848703] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0cb41b0f-cdd2-4222-95b4-bafd614b7460',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1096.895105] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.895299] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.895387] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.895658] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.895767] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.895873] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d82bad56-9830-4c7d-9763-6d8a05e0998c is going to be updated. [ 1096.931571] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.931789] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.931870] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.932072] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.932228] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.956021] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d82bad56-9830-4c7d-9763-6d8a05e0998c in Status: IN_PROGRESS for 2s [ 1097.087563] env[65306]: INFO networking_nsxv3.common.synchronization [req-dd3f202f-b98a-423e-9081-80fa8f3e78ca req-c1e99673-df6f-4400-b06b-e2da5b96be44 tempest-ServerRescueNegativeTestJSON-1491097463 tempest-ServerRescueNegativeTestJSON-1491097463-project-member] Enqueued Resource ID: b8dc2b13-0f06-4660-ab7d-a65578892823 with Priority: HIGHEST for action security_group_members [ 1097.087563] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b8dc2b13-0f06-4660-ab7d-a65578892823 with Priority: HIGHEST for action security_group_members [ 1097.087563] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-b8dc2b13-0f06-4660-ab7d-a65578892823 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.087563] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b8dc2b13-0f06-4660-ab7d-a65578892823" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.087563] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b8dc2b13-0f06-4660-ab7d-a65578892823" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.087888] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b8dc2b13-0f06-4660-ab7d-a65578892823" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.088069] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.088069] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.088290] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.088452] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.088452] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.088553] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b8dc2b13-0f06-4660-ab7d-a65578892823',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1097.350968] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.351317] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.351451] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.351747] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.351946] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.352196] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0cb41b0f-cdd2-4222-95b4-bafd614b7460 is going to be updated. [ 1097.400070] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.400223] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.400310] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.400510] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.400666] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.410458] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0cb41b0f-cdd2-4222-95b4-bafd614b7460 in Status: IN_PROGRESS for 2s [ 1097.467476] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock network-845 taken with stack trace [, , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.469315] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "network-845" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.469315] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "network-845" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.469315] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "network-845" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.469315] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.469315] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.469315] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.469315] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.469315] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.469315] env[65306]: DEBUG dogpile.cache.region [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] No value present for key: 'zone-id' {{(pid=65306) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1097.469315] env[65306]: DEBUG dogpile.lock [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] NeedRegenerationException {{(pid=65306) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1097.469678] env[65306]: DEBUG dogpile.lock [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] no value, waiting for create lock {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1097.469678] env[65306]: DEBUG dogpile.lock [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] value creation lock acquired {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1097.469678] env[65306]: DEBUG dogpile.cache.region [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] No value present for key: 'zone-id' {{(pid=65306) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1097.469800] env[65306]: DEBUG dogpile.lock [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Calling creation function for not-yet-present value {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1097.469838] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1097.495414] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1097.495524] env[65306]: DEBUG dogpile.cache.region [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=65306) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1097.495617] env[65306]: DEBUG dogpile.lock [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Released creation lock {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1097.495798] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "network-845" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.496477] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock port-6aba4679-7aa0-45ed-bbf6-61f185c24d5d taken with stack trace [, , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.496477] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "port-6aba4679-7aa0-45ed-bbf6-61f185c24d5d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.496477] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "port-6aba4679-7aa0-45ed-bbf6-61f185c24d5d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.496781] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "port-6aba4679-7aa0-45ed-bbf6-61f185c24d5d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.496922] env[65306]: DEBUG networking_nsxv3.api.rpc [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6aba4679-7aa0-45ed-bbf6-61f185c24d5d',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1097.592353] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.592514] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.592589] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.592801] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.592896] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.593324] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.593324] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.593324] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.593493] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.593522] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.593598] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b8dc2b13-0f06-4660-ab7d-a65578892823 already deleted. [ 1097.593681] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b8dc2b13-0f06-4660-ab7d-a65578892823" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.999344] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.999767] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.999767] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.000047] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.000214] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.000376] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Segment Port 6aba4679-7aa0-45ed-bbf6-61f185c24d5d not found, creating... [ 1098.000635] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.000806] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.000926] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.001264] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.001426] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.001721] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.001930] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.001984] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.002208] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.002345] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.002509] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Resource: SegmentPort with ID: 6aba4679-7aa0-45ed-bbf6-61f185c24d5d is going to be created. [ 1098.032142] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.032388] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.032435] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.032713] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.032941] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.033221] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "port-6aba4679-7aa0-45ed-bbf6-61f185c24d5d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.967102] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d82bad56-9830-4c7d-9763-6d8a05e0998c in Status: SUCCESS [ 1098.967330] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d82bad56-9830-4c7d-9763-6d8a05e0998c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.967499] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d82bad56-9830-4c7d-9763-6d8a05e0998c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.967724] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d82bad56-9830-4c7d-9763-6d8a05e0998c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.967903] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.968028] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.968088] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.968248] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.968334] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.968420] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d82bad56-9830-4c7d-9763-6d8a05e0998c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.968507] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d82bad56-9830-4c7d-9763-6d8a05e0998c',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1099.189260] env[65306]: INFO networking_nsxv3.common.synchronization [req-dd3f202f-b98a-423e-9081-80fa8f3e78ca req-dec23aa5-8ed4-40cb-bfe5-e85167750b6a service nova] Enqueued Resource ID: b8dc2b13-0f06-4660-ab7d-a65578892823 with Priority: HIGHEST for action security_group_rules [ 1099.189645] env[65306]: INFO networking_nsxv3.common.synchronization [req-dd3f202f-b98a-423e-9081-80fa8f3e78ca req-dec23aa5-8ed4-40cb-bfe5-e85167750b6a service nova] Enqueued Resource ID: b8dc2b13-0f06-4660-ab7d-a65578892823 with Priority: HIGHEST for action security_group_members [ 1099.189645] env[65306]: INFO networking_nsxv3.common.synchronization [req-dd3f202f-b98a-423e-9081-80fa8f3e78ca req-dec23aa5-8ed4-40cb-bfe5-e85167750b6a service nova] Enqueued Resource ID: 6aba4679-7aa0-45ed-bbf6-61f185c24d5d with Priority: HIGHEST for action port [ 1099.192891] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b8dc2b13-0f06-4660-ab7d-a65578892823 with Priority: HIGHEST for action security_group_rules [ 1099.193066] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b8dc2b13-0f06-4660-ab7d-a65578892823 with Priority: HIGHEST for action security_group_members [ 1099.193695] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6aba4679-7aa0-45ed-bbf6-61f185c24d5d with Priority: HIGHEST for action port [ 1099.194074] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b8dc2b13-0f06-4660-ab7d-a65578892823 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.194156] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b8dc2b13-0f06-4660-ab7d-a65578892823" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.194208] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b8dc2b13-0f06-4660-ab7d-a65578892823" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.194423] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b8dc2b13-0f06-4660-ab7d-a65578892823" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.194520] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b8dc2b13-0f06-4660-ab7d-a65578892823',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1099.195568] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-b8dc2b13-0f06-4660-ab7d-a65578892823 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.195706] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b8dc2b13-0f06-4660-ab7d-a65578892823" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.195847] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b8dc2b13-0f06-4660-ab7d-a65578892823" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.196292] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b8dc2b13-0f06-4660-ab7d-a65578892823" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.197522] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.197522] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.197522] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.197522] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.197711] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.197814] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b8dc2b13-0f06-4660-ab7d-a65578892823',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1099.201133] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock port-6aba4679-7aa0-45ed-bbf6-61f185c24d5d taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.201418] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6aba4679-7aa0-45ed-bbf6-61f185c24d5d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.202808] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6aba4679-7aa0-45ed-bbf6-61f185c24d5d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.203531] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6aba4679-7aa0-45ed-bbf6-61f185c24d5d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.204292] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6aba4679-7aa0-45ed-bbf6-61f185c24d5d',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1099.424903] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0cb41b0f-cdd2-4222-95b4-bafd614b7460 in Status: SUCCESS [ 1099.424903] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0cb41b0f-cdd2-4222-95b4-bafd614b7460" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.471411] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-d82bad56-9830-4c7d-9763-6d8a05e0998c taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.471641] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d82bad56-9830-4c7d-9763-6d8a05e0998c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.471641] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d82bad56-9830-4c7d-9763-6d8a05e0998c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.471849] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d82bad56-9830-4c7d-9763-6d8a05e0998c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.472174] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.472341] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.472429] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.472662] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.472762] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.472922] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d82bad56-9830-4c7d-9763-6d8a05e0998c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.473283] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-d82bad56-9830-4c7d-9763-6d8a05e0998c taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.473418] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d82bad56-9830-4c7d-9763-6d8a05e0998c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.473517] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d82bad56-9830-4c7d-9763-6d8a05e0998c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.473772] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d82bad56-9830-4c7d-9763-6d8a05e0998c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.474029] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.474192] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.474310] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.474613] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.474751] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.474895] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d82bad56-9830-4c7d-9763-6d8a05e0998c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.475065] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d82bad56-9830-4c7d-9763-6d8a05e0998c',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1099.602717] env[65306]: INFO networking_nsxv3.common.synchronization [req-b2279ae5-2083-4acd-80ed-7cf8c9f98374 req-3726d13c-5928-474a-a1fc-51563aa0a2f0 tempest-ServerRescueNegativeTestJSON-1491097463 tempest-ServerRescueNegativeTestJSON-1491097463-project-member] Enqueued Resource ID: b8dc2b13-0f06-4660-ab7d-a65578892823 with Priority: HIGHEST for action security_group_members [ 1099.603351] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b8dc2b13-0f06-4660-ab7d-a65578892823 with Priority: HIGHEST for action security_group_members [ 1099.603716] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-b8dc2b13-0f06-4660-ab7d-a65578892823 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.603843] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b8dc2b13-0f06-4660-ab7d-a65578892823" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.707731] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-b8dc2b13-0f06-4660-ab7d-a65578892823 taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.707731] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b8dc2b13-0f06-4660-ab7d-a65578892823" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.707731] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b8dc2b13-0f06-4660-ab7d-a65578892823',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1099.709236] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6aba4679-7aa0-45ed-bbf6-61f185c24d5d with status ACTIVE [ 1099.709611] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.709787] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.709894] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.710145] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.710252] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.711086] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.711151] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.711214] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.711395] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.711480] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.711675] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.711789] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.711862] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.712018] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.712099] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.712189] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6aba4679-7aa0-45ed-bbf6-61f185c24d5d is going to be updated. [ 1099.737051] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.737051] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.737051] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.737336] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.737336] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.737781] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6aba4679-7aa0-45ed-bbf6-61f185c24d5d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.931303] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock network-845 taken with stack trace [, , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.931507] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "network-845" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.931633] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "network-845" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.931902] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "network-845" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.932176] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.932337] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.932455] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.932671] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.932813] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.933044] env[65306]: DEBUG dogpile.cache.region [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] No value present for key: 'zone-id' {{(pid=65306) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1099.933193] env[65306]: DEBUG dogpile.lock [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] NeedRegenerationException {{(pid=65306) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1099.933306] env[65306]: DEBUG dogpile.lock [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] no value, waiting for create lock {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1099.933414] env[65306]: DEBUG dogpile.lock [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] value creation lock acquired {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1099.933524] env[65306]: DEBUG dogpile.cache.region [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] No value present for key: 'zone-id' {{(pid=65306) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1099.933626] env[65306]: DEBUG dogpile.lock [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Calling creation function for not-yet-present value {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1099.933758] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1099.955550] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1099.955736] env[65306]: DEBUG dogpile.cache.region [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65306) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1099.955855] env[65306]: DEBUG dogpile.lock [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Released creation lock {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1099.956035] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "network-845" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.956359] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock port-47993949-f9eb-44f8-8a91-b21675bdc156 taken with stack trace [, , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.956540] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "port-47993949-f9eb-44f8-8a91-b21675bdc156" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.956659] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "port-47993949-f9eb-44f8-8a91-b21675bdc156" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.956968] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "port-47993949-f9eb-44f8-8a91-b21675bdc156" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.957119] env[65306]: DEBUG networking_nsxv3.api.rpc [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('47993949-f9eb-44f8-8a91-b21675bdc156',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1099.978035] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d82bad56-9830-4c7d-9763-6d8a05e0998c: rpc.has_security_group_logging(os_id): False [ 1100.005253] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.005454] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.005545] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.005754] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.005847] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.006098] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.006205] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.006273] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.006450] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.006536] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.006748] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.006867] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.006933] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.007127] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.007226] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.007400] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.007496] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.007550] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.007725] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.007807] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.007902] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d82bad56-9830-4c7d-9763-6d8a05e0998c is going to be updated. [ 1100.103085] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.103382] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.103382] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.103595] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.103747] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.118333] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d82bad56-9830-4c7d-9763-6d8a05e0998c in Status: IN_PROGRESS for 2s [ 1100.210307] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b8dc2b13-0f06-4660-ab7d-a65578892823',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1100.459938] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.460178] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.460306] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.460578] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.460727] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.460875] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Segment Port 47993949-f9eb-44f8-8a91-b21675bdc156 not found, creating... [ 1100.461137] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.461296] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.461414] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.461624] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.461759] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.462045] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.462303] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.462368] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.462518] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.462649] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.462804] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Resource: SegmentPort with ID: 47993949-f9eb-44f8-8a91-b21675bdc156 is going to be created. [ 1100.488220] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.488437] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.488562] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.488833] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.489068] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.489294] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "port-47993949-f9eb-44f8-8a91-b21675bdc156" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.713888] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.714161] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.714161] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.714291] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.714432] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.714563] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b8dc2b13-0f06-4660-ab7d-a65578892823 is going to be created. [ 1100.742061] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.742257] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.742257] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.742387] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.742547] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.753907] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b8dc2b13-0f06-4660-ab7d-a65578892823 in Status: UNINITIALIZED for 2s [ 1101.205719] env[65306]: INFO networking_nsxv3.common.synchronization [req-b2279ae5-2083-4acd-80ed-7cf8c9f98374 req-a30bf2f3-bfc5-452c-ba89-2051eb4d9d94 service nova] Enqueued Resource ID: b8dc2b13-0f06-4660-ab7d-a65578892823 with Priority: HIGHEST for action security_group_rules [ 1101.205719] env[65306]: INFO networking_nsxv3.common.synchronization [req-b2279ae5-2083-4acd-80ed-7cf8c9f98374 req-a30bf2f3-bfc5-452c-ba89-2051eb4d9d94 service nova] Enqueued Resource ID: b8dc2b13-0f06-4660-ab7d-a65578892823 with Priority: HIGHEST for action security_group_members [ 1101.205719] env[65306]: INFO networking_nsxv3.common.synchronization [req-b2279ae5-2083-4acd-80ed-7cf8c9f98374 req-a30bf2f3-bfc5-452c-ba89-2051eb4d9d94 service nova] Enqueued Resource ID: 47993949-f9eb-44f8-8a91-b21675bdc156 with Priority: HIGHEST for action port [ 1101.205719] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b8dc2b13-0f06-4660-ab7d-a65578892823 with Priority: HIGHEST for action security_group_rules [ 1101.205719] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b8dc2b13-0f06-4660-ab7d-a65578892823 with Priority: HIGHEST for action security_group_members [ 1101.206150] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 47993949-f9eb-44f8-8a91-b21675bdc156 with Priority: HIGHEST for action port [ 1101.206150] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b8dc2b13-0f06-4660-ab7d-a65578892823 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.206213] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b8dc2b13-0f06-4660-ab7d-a65578892823" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.206416] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-b8dc2b13-0f06-4660-ab7d-a65578892823 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.206493] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b8dc2b13-0f06-4660-ab7d-a65578892823" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.206639] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock port-47993949-f9eb-44f8-8a91-b21675bdc156 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.206806] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-47993949-f9eb-44f8-8a91-b21675bdc156" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.206806] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-47993949-f9eb-44f8-8a91-b21675bdc156" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.207253] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-47993949-f9eb-44f8-8a91-b21675bdc156" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.207253] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('47993949-f9eb-44f8-8a91-b21675bdc156',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1101.709558] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 47993949-f9eb-44f8-8a91-b21675bdc156 with status ACTIVE [ 1101.709885] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.709965] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.710023] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.710268] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.710358] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.710554] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.710651] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.710706] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.710878] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.710946] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.711155] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.711267] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.711330] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.711483] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.711554] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.711641] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 47993949-f9eb-44f8-8a91-b21675bdc156 is going to be updated. [ 1101.739912] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.740105] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.740251] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.740546] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.740716] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.740904] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-47993949-f9eb-44f8-8a91-b21675bdc156" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.782266] env[65306]: INFO networking_nsxv3.common.synchronization [req-2cfbb960-c7fc-431d-8855-5d2bacbefeb6 req-ece1305a-ec4b-4bcd-a35f-8f83abf98277 tempest-AttachVolumeNegativeTest-723798471 tempest-AttachVolumeNegativeTest-723798471-project-member] Enqueued Resource ID: 979b0e99-7f65-434d-a9e9-1ff018f5b499 with Priority: HIGHEST for action security_group_members [ 1101.782891] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 979b0e99-7f65-434d-a9e9-1ff018f5b499 with Priority: HIGHEST for action security_group_members [ 1101.783865] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-979b0e99-7f65-434d-a9e9-1ff018f5b499 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.783865] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-979b0e99-7f65-434d-a9e9-1ff018f5b499" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.784015] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-979b0e99-7f65-434d-a9e9-1ff018f5b499" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.784153] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-979b0e99-7f65-434d-a9e9-1ff018f5b499" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.784323] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.784420] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.784486] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.784644] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.784733] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.784827] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('979b0e99-7f65-434d-a9e9-1ff018f5b499',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1102.133533] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d82bad56-9830-4c7d-9763-6d8a05e0998c in Status: SUCCESS [ 1102.134118] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d82bad56-9830-4c7d-9763-6d8a05e0998c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.288036] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.288290] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.288391] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.288877] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.288877] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.289141] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.289314] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.289428] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.289662] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.289792] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.289936] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 979b0e99-7f65-434d-a9e9-1ff018f5b499 is going to be updated. [ 1102.318214] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.318425] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.318509] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.318737] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.318880] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.337270] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 979b0e99-7f65-434d-a9e9-1ff018f5b499 in Status: IN_PROGRESS for 2s [ 1102.419702] env[65306]: INFO networking_nsxv3.common.synchronization [req-c48fe1be-269f-4286-99d5-2f1da2ff7fbc req-db9a156a-2792-4789-a133-c87faabb470d tempest-ServerActionsTestOtherB-1027609472 tempest-ServerActionsTestOtherB-1027609472-project-member] Enqueued Resource ID: 37349b8b-c2c1-4141-8b10-752c27492cbd with Priority: HIGHEST for action security_group_members [ 1102.420306] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 37349b8b-c2c1-4141-8b10-752c27492cbd with Priority: HIGHEST for action security_group_members [ 1102.420678] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-37349b8b-c2c1-4141-8b10-752c27492cbd taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.420852] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-37349b8b-c2c1-4141-8b10-752c27492cbd" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.420980] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-37349b8b-c2c1-4141-8b10-752c27492cbd" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.421335] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-37349b8b-c2c1-4141-8b10-752c27492cbd" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.421534] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.421711] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.421711] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.421895] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.421945] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.422059] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('37349b8b-c2c1-4141-8b10-752c27492cbd',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1102.764093] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b8dc2b13-0f06-4660-ab7d-a65578892823 in Status: SUCCESS [ 1102.766391] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b8dc2b13-0f06-4660-ab7d-a65578892823" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.766391] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b8dc2b13-0f06-4660-ab7d-a65578892823" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.766391] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b8dc2b13-0f06-4660-ab7d-a65578892823" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.766391] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.766391] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.766391] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.766391] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.766391] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.766391] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b8dc2b13-0f06-4660-ab7d-a65578892823',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1102.924592] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.925312] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.925486] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.926616] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.926616] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.926616] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.926616] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.926616] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.926967] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.926967] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.926967] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 37349b8b-c2c1-4141-8b10-752c27492cbd is going to be updated. [ 1102.957797] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.958021] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.958021] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.958327] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.958695] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.973411] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 37349b8b-c2c1-4141-8b10-752c27492cbd in Status: IN_PROGRESS for 2s [ 1103.272233] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b8dc2b13-0f06-4660-ab7d-a65578892823',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1103.774115] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b8dc2b13-0f06-4660-ab7d-a65578892823',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1104.281094] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.281094] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.281094] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.281094] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.281094] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.281094] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b8dc2b13-0f06-4660-ab7d-a65578892823 is going to be updated. [ 1104.340871] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.340984] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.340984] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.341303] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.341487] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.352915] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 979b0e99-7f65-434d-a9e9-1ff018f5b499 in Status: SUCCESS [ 1104.352915] env[65306]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 979b0e99-7f65-434d-a9e9-1ff018f5b499 deletion is rescheduled due to dependency. [ 1104.352915] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-979b0e99-7f65-434d-a9e9-1ff018f5b499" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.356588] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b8dc2b13-0f06-4660-ab7d-a65578892823 in Status: IN_PROGRESS for 2s [ 1104.990328] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 37349b8b-c2c1-4141-8b10-752c27492cbd in Status: SUCCESS [ 1104.990708] env[65306]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 37349b8b-c2c1-4141-8b10-752c27492cbd deletion is rescheduled due to dependency. [ 1104.990708] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-37349b8b-c2c1-4141-8b10-752c27492cbd" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.797822] env[65306]: INFO networking_nsxv3.common.synchronization [req-84c802a6-b70d-4bef-aaca-fe4243c2b8e2 req-6c275b89-8061-4f55-8e33-d9b540f093db tempest-AttachVolumeTestJSON-1277615836 tempest-AttachVolumeTestJSON-1277615836-project-member] Enqueued Resource ID: 331be455-1cf8-4667-8d43-bd7a51712610 with Priority: HIGHEST for action security_group_members [ 1105.798553] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 331be455-1cf8-4667-8d43-bd7a51712610 with Priority: HIGHEST for action security_group_members [ 1105.798922] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-331be455-1cf8-4667-8d43-bd7a51712610 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.799087] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-331be455-1cf8-4667-8d43-bd7a51712610" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.799162] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-331be455-1cf8-4667-8d43-bd7a51712610" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.799379] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-331be455-1cf8-4667-8d43-bd7a51712610" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.799556] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.799666] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.799714] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.799890] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.799992] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.800113] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('331be455-1cf8-4667-8d43-bd7a51712610',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1106.304568] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.304568] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.304568] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.304568] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.304568] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.305091] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.305091] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.305091] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.305091] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.305317] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.305317] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 331be455-1cf8-4667-8d43-bd7a51712610 is going to be updated. [ 1106.337643] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.337952] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.337952] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.338117] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.338263] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.351965] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 331be455-1cf8-4667-8d43-bd7a51712610 in Status: IN_PROGRESS for 2s [ 1106.365548] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b8dc2b13-0f06-4660-ab7d-a65578892823 in Status: SUCCESS [ 1106.365702] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b8dc2b13-0f06-4660-ab7d-a65578892823" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.367227] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b8dc2b13-0f06-4660-ab7d-a65578892823" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.367227] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b8dc2b13-0f06-4660-ab7d-a65578892823" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.367227] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.367227] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.367227] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.367227] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.367227] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.367227] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b8dc2b13-0f06-4660-ab7d-a65578892823" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.367227] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b8dc2b13-0f06-4660-ab7d-a65578892823',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1106.367998] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b8dc2b13-0f06-4660-ab7d-a65578892823" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.367998] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b8dc2b13-0f06-4660-ab7d-a65578892823" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.368264] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.368349] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.368402] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.371992] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.371992] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.371992] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b8dc2b13-0f06-4660-ab7d-a65578892823',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1106.721614] env[65306]: INFO networking_nsxv3.common.synchronization [req-92200cd4-32dd-4e3f-9427-deb714c25e3b req-a0d5bfe5-58f2-404c-9ca3-cd7be46386d7 tempest-ServerDiskConfigTestJSON-771154958 tempest-ServerDiskConfigTestJSON-771154958-project-member] Enqueued Resource ID: 9e80329d-1fcd-4c50-8991-a90e2a1fbdbc with Priority: HIGHEST for action security_group_members [ 1106.722228] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9e80329d-1fcd-4c50-8991-a90e2a1fbdbc with Priority: HIGHEST for action security_group_members [ 1106.722570] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-9e80329d-1fcd-4c50-8991-a90e2a1fbdbc taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.722710] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9e80329d-1fcd-4c50-8991-a90e2a1fbdbc" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.722797] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9e80329d-1fcd-4c50-8991-a90e2a1fbdbc" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.723021] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9e80329d-1fcd-4c50-8991-a90e2a1fbdbc" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.723240] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.723664] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.723740] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.723949] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.724105] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.724466] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9e80329d-1fcd-4c50-8991-a90e2a1fbdbc',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1106.876984] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-b8dc2b13-0f06-4660-ab7d-a65578892823 taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.877156] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b8dc2b13-0f06-4660-ab7d-a65578892823" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.877532] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b8dc2b13-0f06-4660-ab7d-a65578892823',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1107.045098] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock network-270 taken with stack trace [, , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.045308] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "network-270" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.045488] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "network-270" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.045738] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "network-270" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.046339] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.046510] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.046770] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.047025] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.047182] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.047393] env[65306]: DEBUG dogpile.cache.region [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] No value present for key: 'zone-id' {{(pid=65306) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1107.047507] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] NeedRegenerationException {{(pid=65306) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1107.047829] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] no value, waiting for create lock {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1107.047829] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] value creation lock acquired {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1107.047829] env[65306]: DEBUG dogpile.cache.region [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] No value present for key: 'zone-id' {{(pid=65306) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1107.047944] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Calling creation function for not-yet-present value {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1107.048058] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1107.068048] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1107.068243] env[65306]: DEBUG dogpile.cache.region [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65306) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1107.068382] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Released creation lock {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1107.068558] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "network-270" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.068874] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock port-2483e5d8-61cb-4cc0-9b9a-953ed7af1309 taken with stack trace [, , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.069052] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "port-2483e5d8-61cb-4cc0-9b9a-953ed7af1309" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.069172] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "port-2483e5d8-61cb-4cc0-9b9a-953ed7af1309" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.069489] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "port-2483e5d8-61cb-4cc0-9b9a-953ed7af1309" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.069631] env[65306]: DEBUG networking_nsxv3.api.rpc [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2483e5d8-61cb-4cc0-9b9a-953ed7af1309',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1107.226659] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.226862] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.226956] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.227209] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.227304] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.227507] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.227609] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.227674] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.227829] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.227909] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.227999] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9e80329d-1fcd-4c50-8991-a90e2a1fbdbc is going to be updated. [ 1107.245596] env[65306]: INFO networking_nsxv3.common.synchronization [None req-5a46b818-8bc0-4fe5-b6d4-b8a25a655e4c None None] Enqueued Resource ID: a8f56c63-0d3b-4bef-a626-becc7683efa8 with Priority: HIGHEST for action port [ 1107.246162] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a8f56c63-0d3b-4bef-a626-becc7683efa8 with Priority: HIGHEST for action port [ 1107.246473] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock port-a8f56c63-0d3b-4bef-a626-becc7683efa8 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.246599] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a8f56c63-0d3b-4bef-a626-becc7683efa8" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.246668] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a8f56c63-0d3b-4bef-a626-becc7683efa8" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.246934] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a8f56c63-0d3b-4bef-a626-becc7683efa8" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.247022] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a8f56c63-0d3b-4bef-a626-becc7683efa8',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1107.261222] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.261304] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.261304] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.262612] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.263122] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.277962] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9e80329d-1fcd-4c50-8991-a90e2a1fbdbc in Status: IN_PROGRESS for 2s [ 1107.379936] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b8dc2b13-0f06-4660-ab7d-a65578892823',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1107.572355] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.572592] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.572722] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.573011] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.574157] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.574480] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.574728] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.574854] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.575106] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.575247] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.575563] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.575761] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.575886] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.576109] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.576247] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.576390] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Resource: SegmentPort with ID: 2483e5d8-61cb-4cc0-9b9a-953ed7af1309 is going to be updated. [ 1107.598981] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.599280] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.599340] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.600269] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.600895] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.600895] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "port-2483e5d8-61cb-4cc0-9b9a-953ed7af1309" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.748865] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a8f56c63-0d3b-4bef-a626-becc7683efa8 [ 1107.752129] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.752589] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.752589] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.752716] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.752758] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.752866] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a8f56c63-0d3b-4bef-a626-becc7683efa8 already deleted. [ 1107.752950] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a8f56c63-0d3b-4bef-a626-becc7683efa8" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.882620] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.883495] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.883495] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.883495] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.883495] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.883495] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b8dc2b13-0f06-4660-ab7d-a65578892823 is going to be updated. [ 1107.927775] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.927935] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.928072] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.928230] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.928376] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.938130] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b8dc2b13-0f06-4660-ab7d-a65578892823 in Status: IN_PROGRESS for 2s [ 1108.372466] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 331be455-1cf8-4667-8d43-bd7a51712610 in Status: SUCCESS [ 1108.372466] env[65306]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 331be455-1cf8-4667-8d43-bd7a51712610 deletion is rescheduled due to dependency. [ 1108.372466] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-331be455-1cf8-4667-8d43-bd7a51712610" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.417663] env[65306]: INFO networking_nsxv3.common.synchronization [req-b779ad76-557a-4e67-9536-2e728b48086d req-c2f0cd51-3ed4-47cc-a762-50628d787398 service nova] Enqueued Resource ID: 4ccf00ad-53bf-45d0-a342-260b14c2ccf2 with Priority: HIGHEST for action security_group_rules [ 1108.417975] env[65306]: INFO networking_nsxv3.common.synchronization [req-b779ad76-557a-4e67-9536-2e728b48086d req-c2f0cd51-3ed4-47cc-a762-50628d787398 service nova] Enqueued Resource ID: 4ccf00ad-53bf-45d0-a342-260b14c2ccf2 with Priority: HIGHEST for action security_group_members [ 1108.417975] env[65306]: INFO networking_nsxv3.common.synchronization [req-b779ad76-557a-4e67-9536-2e728b48086d req-c2f0cd51-3ed4-47cc-a762-50628d787398 service nova] Enqueued Resource ID: 2483e5d8-61cb-4cc0-9b9a-953ed7af1309 with Priority: HIGHEST for action port [ 1108.420925] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4ccf00ad-53bf-45d0-a342-260b14c2ccf2 with Priority: HIGHEST for action security_group_rules [ 1108.420925] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4ccf00ad-53bf-45d0-a342-260b14c2ccf2 with Priority: HIGHEST for action security_group_members [ 1108.420925] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2483e5d8-61cb-4cc0-9b9a-953ed7af1309 with Priority: HIGHEST for action port [ 1108.423377] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4ccf00ad-53bf-45d0-a342-260b14c2ccf2 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.423377] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4ccf00ad-53bf-45d0-a342-260b14c2ccf2" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.423377] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4ccf00ad-53bf-45d0-a342-260b14c2ccf2" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.423581] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4ccf00ad-53bf-45d0-a342-260b14c2ccf2" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.423581] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4ccf00ad-53bf-45d0-a342-260b14c2ccf2',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1108.424470] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-4ccf00ad-53bf-45d0-a342-260b14c2ccf2 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.424587] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4ccf00ad-53bf-45d0-a342-260b14c2ccf2" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.424652] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4ccf00ad-53bf-45d0-a342-260b14c2ccf2" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.424831] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4ccf00ad-53bf-45d0-a342-260b14c2ccf2" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.424976] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.425124] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.425169] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.427019] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.427019] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.427019] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4ccf00ad-53bf-45d0-a342-260b14c2ccf2',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1108.427019] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock port-2483e5d8-61cb-4cc0-9b9a-953ed7af1309 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.427019] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2483e5d8-61cb-4cc0-9b9a-953ed7af1309" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.427019] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2483e5d8-61cb-4cc0-9b9a-953ed7af1309" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.427019] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2483e5d8-61cb-4cc0-9b9a-953ed7af1309" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.427019] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2483e5d8-61cb-4cc0-9b9a-953ed7af1309',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1108.931863] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4ccf00ad-53bf-45d0-a342-260b14c2ccf2',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1108.931863] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-4ccf00ad-53bf-45d0-a342-260b14c2ccf2 taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.931863] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4ccf00ad-53bf-45d0-a342-260b14c2ccf2" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.931863] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2483e5d8-61cb-4cc0-9b9a-953ed7af1309 with status ACTIVE [ 1108.931863] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.932303] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.932303] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.932451] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.932451] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.932659] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.932807] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.932851] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.933045] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.933122] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.933339] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.933505] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.933505] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.933636] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.933734] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.933776] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2483e5d8-61cb-4cc0-9b9a-953ed7af1309 is going to be updated. [ 1108.962366] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.962460] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.962521] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.963169] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.965541] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.965541] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2483e5d8-61cb-4cc0-9b9a-953ed7af1309" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.288553] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9e80329d-1fcd-4c50-8991-a90e2a1fbdbc in Status: SUCCESS [ 1109.288768] env[65306]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9e80329d-1fcd-4c50-8991-a90e2a1fbdbc deletion is rescheduled due to dependency. [ 1109.288878] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9e80329d-1fcd-4c50-8991-a90e2a1fbdbc" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.436030] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4ccf00ad-53bf-45d0-a342-260b14c2ccf2',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1109.599628] env[65306]: INFO networking_nsxv3.common.synchronization [None req-65be3c3e-12a6-497f-a740-c6023620098b None None] Enqueued Resource ID: d947f0fe-4329-496b-99ea-9ed9796325b3 with Priority: HIGHEST for action port [ 1109.601336] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d947f0fe-4329-496b-99ea-9ed9796325b3 with Priority: HIGHEST for action port [ 1109.601686] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock port-d947f0fe-4329-496b-99ea-9ed9796325b3 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.601819] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d947f0fe-4329-496b-99ea-9ed9796325b3" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.601870] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d947f0fe-4329-496b-99ea-9ed9796325b3" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.602952] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d947f0fe-4329-496b-99ea-9ed9796325b3" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.602952] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d947f0fe-4329-496b-99ea-9ed9796325b3',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1109.741210] env[65306]: INFO networking_nsxv3.common.synchronization [req-2e04a4be-9de1-4ded-bee0-072fab9820c3 req-a0da10f7-657c-4011-bec6-ec77c106a576 tempest-AttachInterfacesTestJSON-144464476 tempest-AttachInterfacesTestJSON-144464476-project-member] Enqueued Resource ID: 4603b17e-9032-4f9f-a8ac-9d7d5e34db46 with Priority: HIGHEST for action security_group_members [ 1109.741210] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4603b17e-9032-4f9f-a8ac-9d7d5e34db46 with Priority: HIGHEST for action security_group_members [ 1109.741210] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-4603b17e-9032-4f9f-a8ac-9d7d5e34db46 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.741210] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4603b17e-9032-4f9f-a8ac-9d7d5e34db46" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.741210] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4603b17e-9032-4f9f-a8ac-9d7d5e34db46" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.741210] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4603b17e-9032-4f9f-a8ac-9d7d5e34db46" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.742161] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.743524] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.743684] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.744229] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.744432] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.744629] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4603b17e-9032-4f9f-a8ac-9d7d5e34db46',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1109.845031] env[65306]: INFO networking_nsxv3.common.synchronization [req-51ae4223-8e7c-4512-b93e-534fd8aa40a3 req-2cfe4c3e-50ef-4ac6-92a8-c15855879374 tempest-ServersNegativeTestJSON-1568308048 tempest-ServersNegativeTestJSON-1568308048-project-member] Enqueued Resource ID: 7c868cfd-e55d-4976-95db-5b3f64c76a5f with Priority: HIGHEST for action security_group_members [ 1109.845031] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7c868cfd-e55d-4976-95db-5b3f64c76a5f with Priority: HIGHEST for action security_group_members [ 1109.845031] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-7c868cfd-e55d-4976-95db-5b3f64c76a5f taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.845031] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7c868cfd-e55d-4976-95db-5b3f64c76a5f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.845031] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7c868cfd-e55d-4976-95db-5b3f64c76a5f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.845031] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7c868cfd-e55d-4976-95db-5b3f64c76a5f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.846611] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.846983] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.847226] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.847535] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.849262] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.849262] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7c868cfd-e55d-4976-95db-5b3f64c76a5f',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1109.939124] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.939350] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.939412] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.941858] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.941858] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.941858] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4ccf00ad-53bf-45d0-a342-260b14c2ccf2 is going to be updated. [ 1109.962984] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b8dc2b13-0f06-4660-ab7d-a65578892823 in Status: SUCCESS [ 1109.963355] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b8dc2b13-0f06-4660-ab7d-a65578892823" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.963532] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b8dc2b13-0f06-4660-ab7d-a65578892823" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.963901] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b8dc2b13-0f06-4660-ab7d-a65578892823" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.964296] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.964296] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.964443] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.964606] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.964732] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.964853] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b8dc2b13-0f06-4660-ab7d-a65578892823" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.965103] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-b8dc2b13-0f06-4660-ab7d-a65578892823 taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.965275] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b8dc2b13-0f06-4660-ab7d-a65578892823" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.965368] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b8dc2b13-0f06-4660-ab7d-a65578892823" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.965603] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b8dc2b13-0f06-4660-ab7d-a65578892823" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.965866] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.966077] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.966150] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.966304] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.966403] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.966503] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b8dc2b13-0f06-4660-ab7d-a65578892823" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.966600] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b8dc2b13-0f06-4660-ab7d-a65578892823',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1109.994784] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.994972] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.995057] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.995832] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.995832] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.011009] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4ccf00ad-53bf-45d0-a342-260b14c2ccf2 in Status: IN_PROGRESS for 2s [ 1110.104987] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d947f0fe-4329-496b-99ea-9ed9796325b3 [ 1110.105259] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.105400] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.105473] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.105706] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.105793] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.105888] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d947f0fe-4329-496b-99ea-9ed9796325b3 already deleted. [ 1110.105972] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d947f0fe-4329-496b-99ea-9ed9796325b3" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.193300] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock network-540 taken with stack trace [, , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.193300] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "network-540" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.193300] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "network-540" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.193300] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "network-540" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.193300] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.193300] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.193300] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.193300] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.193300] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.193300] env[65306]: DEBUG dogpile.cache.region [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] No value present for key: 'zone-id' {{(pid=65306) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1110.194145] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] NeedRegenerationException {{(pid=65306) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1110.194429] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] no value, waiting for create lock {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1110.194665] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] value creation lock acquired {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1110.194918] env[65306]: DEBUG dogpile.cache.region [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] No value present for key: 'zone-id' {{(pid=65306) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1110.195167] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Calling creation function for not-yet-present value {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1110.195420] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1110.217742] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1110.217856] env[65306]: DEBUG dogpile.cache.region [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65306) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1110.218049] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Released creation lock {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1110.219190] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "network-540" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.219190] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock port-dbbef562-cf8f-45fa-a0a7-ad39d1709406 taken with stack trace [, , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.219190] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "port-dbbef562-cf8f-45fa-a0a7-ad39d1709406" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.219190] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "port-dbbef562-cf8f-45fa-a0a7-ad39d1709406" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.219647] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "port-dbbef562-cf8f-45fa-a0a7-ad39d1709406" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.219750] env[65306]: DEBUG networking_nsxv3.api.rpc [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dbbef562-cf8f-45fa-a0a7-ad39d1709406',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1110.247961] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.248234] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.248357] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.248671] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.248830] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.249131] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.249245] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.249312] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.249508] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.249610] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.249730] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4603b17e-9032-4f9f-a8ac-9d7d5e34db46 already deleted. [ 1110.249831] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4603b17e-9032-4f9f-a8ac-9d7d5e34db46" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.350509] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.351190] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.353721] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.353721] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.353721] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.353721] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.353721] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.353721] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.353721] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.353721] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.353721] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7c868cfd-e55d-4976-95db-5b3f64c76a5f is going to be updated. [ 1110.387013] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.387013] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.387013] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.387013] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.387415] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.398279] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7c868cfd-e55d-4976-95db-5b3f64c76a5f in Status: IN_PROGRESS for 2s [ 1110.470387] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b8dc2b13-0f06-4660-ab7d-a65578892823: rpc.has_security_group_logging(os_id): False [ 1110.496995] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.497216] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.497294] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.497537] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.497631] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.497856] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.497957] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.498030] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.498185] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.498264] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.498449] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.498589] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.498679] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.498869] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.498923] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.499167] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.499312] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.499371] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.499471] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.499548] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.499636] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b8dc2b13-0f06-4660-ab7d-a65578892823 is going to be created. [ 1110.567891] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.568134] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.568134] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.568317] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.568499] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.593582] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b8dc2b13-0f06-4660-ab7d-a65578892823 in Status: IN_PROGRESS for 2s [ 1110.722929] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.723290] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.723456] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.723840] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.724138] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.724373] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Segment Port dbbef562-cf8f-45fa-a0a7-ad39d1709406 not found, creating... [ 1110.724747] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.724966] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.725151] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.725474] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.725677] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.726088] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.726310] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.726491] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.726773] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.726969] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.727202] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Resource: SegmentPort with ID: dbbef562-cf8f-45fa-a0a7-ad39d1709406 is going to be created. [ 1110.752475] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.752804] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.752926] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.753229] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.753589] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.753816] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "port-dbbef562-cf8f-45fa-a0a7-ad39d1709406" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.508099] env[65306]: INFO networking_nsxv3.common.synchronization [req-2e04a4be-9de1-4ded-bee0-072fab9820c3 req-c935adf4-ed63-4719-8517-1437fa805c2a service nova] Enqueued Resource ID: 4603b17e-9032-4f9f-a8ac-9d7d5e34db46 with Priority: HIGHEST for action security_group_rules [ 1111.508099] env[65306]: INFO networking_nsxv3.common.synchronization [req-2e04a4be-9de1-4ded-bee0-072fab9820c3 req-c935adf4-ed63-4719-8517-1437fa805c2a service nova] Enqueued Resource ID: 4603b17e-9032-4f9f-a8ac-9d7d5e34db46 with Priority: HIGHEST for action security_group_members [ 1111.508099] env[65306]: INFO networking_nsxv3.common.synchronization [req-2e04a4be-9de1-4ded-bee0-072fab9820c3 req-c935adf4-ed63-4719-8517-1437fa805c2a service nova] Enqueued Resource ID: dbbef562-cf8f-45fa-a0a7-ad39d1709406 with Priority: HIGHEST for action port [ 1111.508628] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4603b17e-9032-4f9f-a8ac-9d7d5e34db46 with Priority: HIGHEST for action security_group_rules [ 1111.508792] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4603b17e-9032-4f9f-a8ac-9d7d5e34db46 with Priority: HIGHEST for action security_group_members [ 1111.509237] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dbbef562-cf8f-45fa-a0a7-ad39d1709406 with Priority: HIGHEST for action port [ 1111.509612] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4603b17e-9032-4f9f-a8ac-9d7d5e34db46 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.509612] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4603b17e-9032-4f9f-a8ac-9d7d5e34db46" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.509764] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4603b17e-9032-4f9f-a8ac-9d7d5e34db46" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.509858] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4603b17e-9032-4f9f-a8ac-9d7d5e34db46" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.509947] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4603b17e-9032-4f9f-a8ac-9d7d5e34db46',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1111.511801] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-4603b17e-9032-4f9f-a8ac-9d7d5e34db46 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.511801] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4603b17e-9032-4f9f-a8ac-9d7d5e34db46" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.511801] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4603b17e-9032-4f9f-a8ac-9d7d5e34db46" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.512018] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4603b17e-9032-4f9f-a8ac-9d7d5e34db46" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.512189] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.512322] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.512353] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.512479] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.512559] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.512653] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4603b17e-9032-4f9f-a8ac-9d7d5e34db46',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1111.514585] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock port-dbbef562-cf8f-45fa-a0a7-ad39d1709406 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.514884] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-dbbef562-cf8f-45fa-a0a7-ad39d1709406" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.514957] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-dbbef562-cf8f-45fa-a0a7-ad39d1709406" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.515136] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-dbbef562-cf8f-45fa-a0a7-ad39d1709406" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.515226] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dbbef562-cf8f-45fa-a0a7-ad39d1709406',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1112.012870] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-4603b17e-9032-4f9f-a8ac-9d7d5e34db46 taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.013073] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4603b17e-9032-4f9f-a8ac-9d7d5e34db46" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.014910] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4603b17e-9032-4f9f-a8ac-9d7d5e34db46',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1112.018339] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port dbbef562-cf8f-45fa-a0a7-ad39d1709406 with status ACTIVE [ 1112.018339] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.018339] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.018339] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.019041] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.019041] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.019676] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.020548] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.020548] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.020548] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.020548] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.020765] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.021395] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.022033] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.022033] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.022033] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.022196] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: dbbef562-cf8f-45fa-a0a7-ad39d1709406 is going to be updated. [ 1112.024181] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4ccf00ad-53bf-45d0-a342-260b14c2ccf2 in Status: SUCCESS [ 1112.024907] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4ccf00ad-53bf-45d0-a342-260b14c2ccf2" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.024907] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4ccf00ad-53bf-45d0-a342-260b14c2ccf2" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.025338] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4ccf00ad-53bf-45d0-a342-260b14c2ccf2" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.025402] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.025607] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.025607] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.025807] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.026095] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.026095] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4ccf00ad-53bf-45d0-a342-260b14c2ccf2" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.026269] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4ccf00ad-53bf-45d0-a342-260b14c2ccf2',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1112.054281] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.055652] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.055652] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.055652] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.055652] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.055652] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-dbbef562-cf8f-45fa-a0a7-ad39d1709406" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.167834] env[65306]: INFO networking_nsxv3.common.synchronization [req-1e71c2b2-d764-4383-8cdb-13445b2ad816 req-27451b26-2c8d-4c01-ac13-b979234f11ee tempest-ServerActionsTestJSON-437813836 tempest-ServerActionsTestJSON-437813836-project-member] Enqueued Resource ID: 6e403189-fcac-40e3-aa50-4c17f4d29895 with Priority: HIGHEST for action security_group_members [ 1112.168430] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6e403189-fcac-40e3-aa50-4c17f4d29895 with Priority: HIGHEST for action security_group_members [ 1112.169822] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-6e403189-fcac-40e3-aa50-4c17f4d29895 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.169822] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6e403189-fcac-40e3-aa50-4c17f4d29895" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.169822] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6e403189-fcac-40e3-aa50-4c17f4d29895" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.169822] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6e403189-fcac-40e3-aa50-4c17f4d29895" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.169822] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.169822] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.169822] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.170387] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.170387] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.170387] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6e403189-fcac-40e3-aa50-4c17f4d29895',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1112.411479] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7c868cfd-e55d-4976-95db-5b3f64c76a5f in Status: SUCCESS [ 1112.411734] env[65306]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7c868cfd-e55d-4976-95db-5b3f64c76a5f deletion is rescheduled due to dependency. [ 1112.411815] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7c868cfd-e55d-4976-95db-5b3f64c76a5f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.516925] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4603b17e-9032-4f9f-a8ac-9d7d5e34db46',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1112.529937] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4ccf00ad-53bf-45d0-a342-260b14c2ccf2',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1112.573604] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock network-910 taken with stack trace [, , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.573790] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "network-910" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.573910] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "network-910" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.574199] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "network-910" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.574549] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.574732] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.574852] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.575077] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.575222] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.575425] env[65306]: DEBUG dogpile.cache.region [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] No value present for key: 'zone-id' {{(pid=65306) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1112.575672] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] NeedRegenerationException {{(pid=65306) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1112.575672] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] no value, waiting for create lock {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1112.575754] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] value creation lock acquired {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1112.575844] env[65306]: DEBUG dogpile.cache.region [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] No value present for key: 'zone-id' {{(pid=65306) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1112.577028] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Calling creation function for not-yet-present value {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1112.577028] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1112.596658] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1112.596822] env[65306]: DEBUG dogpile.cache.region [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65306) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1112.596960] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Released creation lock {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1112.597143] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "network-910" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.597450] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock port-dfdfd6bd-0aa4-4523-8229-9b5f8e350a80 taken with stack trace [, , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.597619] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "port-dfdfd6bd-0aa4-4523-8229-9b5f8e350a80" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.597739] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "port-dfdfd6bd-0aa4-4523-8229-9b5f8e350a80" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.598173] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "port-dfdfd6bd-0aa4-4523-8229-9b5f8e350a80" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.598333] env[65306]: DEBUG networking_nsxv3.api.rpc [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dfdfd6bd-0aa4-4523-8229-9b5f8e350a80',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1112.606285] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b8dc2b13-0f06-4660-ab7d-a65578892823 in Status: SUCCESS [ 1112.606454] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b8dc2b13-0f06-4660-ab7d-a65578892823" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.607159] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b8dc2b13-0f06-4660-ab7d-a65578892823" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.607159] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b8dc2b13-0f06-4660-ab7d-a65578892823" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.607159] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b8dc2b13-0f06-4660-ab7d-a65578892823',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1112.675664] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.675863] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.675941] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.676195] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.676295] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.676503] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.676608] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.676673] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.676828] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.676905] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.676995] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6e403189-fcac-40e3-aa50-4c17f4d29895 is going to be updated. [ 1112.703495] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.703665] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.703708] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.704620] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.704620] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.715249] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6e403189-fcac-40e3-aa50-4c17f4d29895 in Status: IN_PROGRESS for 2s [ 1113.019818] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.020054] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.020100] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.020332] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.020430] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.020543] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4603b17e-9032-4f9f-a8ac-9d7d5e34db46 is going to be created. [ 1113.032627] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4ccf00ad-53bf-45d0-a342-260b14c2ccf2: rpc.has_security_group_logging(os_id): False [ 1113.046682] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.046931] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.046931] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.047107] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.047268] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.053124] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.053355] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.053458] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.053758] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.058361] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4603b17e-9032-4f9f-a8ac-9d7d5e34db46 in Status: UNINITIALIZED for 2s [ 1113.076210] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.076506] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.076620] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.076691] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.076894] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.076977] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.077079] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4ccf00ad-53bf-45d0-a342-260b14c2ccf2 is going to be updated. [ 1113.102710] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.102960] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.103108] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.103943] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.104132] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.104381] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Segment Port dfdfd6bd-0aa4-4523-8229-9b5f8e350a80 not found, creating... [ 1113.104677] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.104844] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.104965] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.105216] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.105356] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.105711] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.105827] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.105944] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.106196] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.106331] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.106471] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Resource: SegmentPort with ID: dfdfd6bd-0aa4-4523-8229-9b5f8e350a80 is going to be created. [ 1113.109217] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-b8dc2b13-0f06-4660-ab7d-a65578892823 taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.109332] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b8dc2b13-0f06-4660-ab7d-a65578892823" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.109430] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b8dc2b13-0f06-4660-ab7d-a65578892823" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.109597] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b8dc2b13-0f06-4660-ab7d-a65578892823" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.109745] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.109840] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.109903] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.110065] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.110139] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.110221] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b8dc2b13-0f06-4660-ab7d-a65578892823" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.110316] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b8dc2b13-0f06-4660-ab7d-a65578892823',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1113.126412] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.126596] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.126596] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.126861] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.127113] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.127364] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "port-dfdfd6bd-0aa4-4523-8229-9b5f8e350a80" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.138488] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.138712] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.138712] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.138927] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.139090] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.153254] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4ccf00ad-53bf-45d0-a342-260b14c2ccf2 in Status: IN_PROGRESS for 2s [ 1113.613232] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-b8dc2b13-0f06-4660-ab7d-a65578892823 taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.613588] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b8dc2b13-0f06-4660-ab7d-a65578892823" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.613588] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b8dc2b13-0f06-4660-ab7d-a65578892823" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.613804] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b8dc2b13-0f06-4660-ab7d-a65578892823" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.613991] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.614174] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.614174] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.614336] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.614448] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.615036] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b8dc2b13-0f06-4660-ab7d-a65578892823" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.615036] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-b8dc2b13-0f06-4660-ab7d-a65578892823 taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.615036] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b8dc2b13-0f06-4660-ab7d-a65578892823" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.615036] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b8dc2b13-0f06-4660-ab7d-a65578892823" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.615036] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b8dc2b13-0f06-4660-ab7d-a65578892823" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.615252] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.615252] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.615333] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.615420] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.615499] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.615609] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b8dc2b13-0f06-4660-ab7d-a65578892823" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.615688] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b8dc2b13-0f06-4660-ab7d-a65578892823',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1113.829166] env[65306]: INFO networking_nsxv3.common.synchronization [req-1e71c2b2-d764-4383-8cdb-13445b2ad816 req-ae40e137-1592-4b26-9268-07205ed694c2 service nova] Enqueued Resource ID: 6e403189-fcac-40e3-aa50-4c17f4d29895 with Priority: HIGHEST for action security_group_rules [ 1113.829447] env[65306]: INFO networking_nsxv3.common.synchronization [req-1e71c2b2-d764-4383-8cdb-13445b2ad816 req-ae40e137-1592-4b26-9268-07205ed694c2 service nova] Enqueued Resource ID: 6e403189-fcac-40e3-aa50-4c17f4d29895 with Priority: HIGHEST for action security_group_members [ 1113.829685] env[65306]: INFO networking_nsxv3.common.synchronization [req-1e71c2b2-d764-4383-8cdb-13445b2ad816 req-ae40e137-1592-4b26-9268-07205ed694c2 service nova] Enqueued Resource ID: dfdfd6bd-0aa4-4523-8229-9b5f8e350a80 with Priority: HIGHEST for action port [ 1113.830792] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6e403189-fcac-40e3-aa50-4c17f4d29895 with Priority: HIGHEST for action security_group_rules [ 1113.830951] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6e403189-fcac-40e3-aa50-4c17f4d29895 with Priority: HIGHEST for action security_group_members [ 1113.831089] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dfdfd6bd-0aa4-4523-8229-9b5f8e350a80 with Priority: HIGHEST for action port [ 1113.831443] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6e403189-fcac-40e3-aa50-4c17f4d29895 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.831565] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6e403189-fcac-40e3-aa50-4c17f4d29895" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.831643] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6e403189-fcac-40e3-aa50-4c17f4d29895" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.832274] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6e403189-fcac-40e3-aa50-4c17f4d29895" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.832274] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6e403189-fcac-40e3-aa50-4c17f4d29895',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1113.833812] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-6e403189-fcac-40e3-aa50-4c17f4d29895 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.834029] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6e403189-fcac-40e3-aa50-4c17f4d29895" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.834272] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock port-dfdfd6bd-0aa4-4523-8229-9b5f8e350a80 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.834842] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-dfdfd6bd-0aa4-4523-8229-9b5f8e350a80" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.834842] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-dfdfd6bd-0aa4-4523-8229-9b5f8e350a80" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.835234] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-dfdfd6bd-0aa4-4523-8229-9b5f8e350a80" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.836258] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dfdfd6bd-0aa4-4523-8229-9b5f8e350a80',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1114.118066] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b8dc2b13-0f06-4660-ab7d-a65578892823: rpc.has_security_group_logging(os_id): False [ 1114.141646] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.141646] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.141646] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.141646] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.141646] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.141646] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.141646] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.141646] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.141646] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.141646] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.141646] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.141646] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.142145] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.142145] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.142145] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.142323] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.142465] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.142624] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.142897] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.143024] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.143137] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b8dc2b13-0f06-4660-ab7d-a65578892823 is going to be updated. [ 1114.214924] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.215359] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.215604] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.215716] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.215959] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.234173] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b8dc2b13-0f06-4660-ab7d-a65578892823 in Status: IN_PROGRESS for 2s [ 1114.337500] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port dfdfd6bd-0aa4-4523-8229-9b5f8e350a80 with status ACTIVE [ 1114.337765] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.337909] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.337985] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.338234] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.338366] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.338584] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.338694] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.338799] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.339046] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.339137] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.339350] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.339460] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.339525] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.339675] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.339750] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.339839] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: dfdfd6bd-0aa4-4523-8229-9b5f8e350a80 is going to be updated. [ 1114.341273] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-6e403189-fcac-40e3-aa50-4c17f4d29895 taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.341411] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6e403189-fcac-40e3-aa50-4c17f4d29895" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.369345] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.369345] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.369345] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.369656] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.369811] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.369988] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-dfdfd6bd-0aa4-4523-8229-9b5f8e350a80" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.725371] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6e403189-fcac-40e3-aa50-4c17f4d29895 in Status: SUCCESS [ 1114.725688] env[65306]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6e403189-fcac-40e3-aa50-4c17f4d29895 deletion is rescheduled due to dependency. [ 1114.725741] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6e403189-fcac-40e3-aa50-4c17f4d29895" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.725930] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6e403189-fcac-40e3-aa50-4c17f4d29895" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.726165] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6e403189-fcac-40e3-aa50-4c17f4d29895" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.726405] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.726533] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.726602] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.726859] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.726956] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.727079] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6e403189-fcac-40e3-aa50-4c17f4d29895',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1115.069354] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4603b17e-9032-4f9f-a8ac-9d7d5e34db46 in Status: SUCCESS [ 1115.069573] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4603b17e-9032-4f9f-a8ac-9d7d5e34db46" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.069804] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4603b17e-9032-4f9f-a8ac-9d7d5e34db46" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.070042] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4603b17e-9032-4f9f-a8ac-9d7d5e34db46" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.070243] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.070363] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.070438] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.070648] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.070753] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.070855] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4603b17e-9032-4f9f-a8ac-9d7d5e34db46" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.070983] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4603b17e-9032-4f9f-a8ac-9d7d5e34db46',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1115.174664] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4ccf00ad-53bf-45d0-a342-260b14c2ccf2 in Status: SUCCESS [ 1115.174664] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4ccf00ad-53bf-45d0-a342-260b14c2ccf2" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.229230] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6e403189-fcac-40e3-aa50-4c17f4d29895',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1115.573596] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4603b17e-9032-4f9f-a8ac-9d7d5e34db46',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1115.731516] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6e403189-fcac-40e3-aa50-4c17f4d29895',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1116.075830] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4603b17e-9032-4f9f-a8ac-9d7d5e34db46: rpc.has_security_group_logging(os_id): False [ 1116.096640] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.096828] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.096923] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.097140] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.097248] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.097537] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.097645] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.097742] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.097920] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.098013] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.098151] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4603b17e-9032-4f9f-a8ac-9d7d5e34db46 is going to be created. [ 1116.188702] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.188969] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.189223] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.189667] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.189830] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.218264] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4603b17e-9032-4f9f-a8ac-9d7d5e34db46 in Status: IN_PROGRESS for 2s [ 1116.236406] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.236665] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.236665] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.236790] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.236904] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.237025] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6e403189-fcac-40e3-aa50-4c17f4d29895 is going to be updated. [ 1116.252995] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b8dc2b13-0f06-4660-ab7d-a65578892823 in Status: SUCCESS [ 1116.252995] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b8dc2b13-0f06-4660-ab7d-a65578892823" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.302306] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.302569] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.302665] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.304522] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.304522] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.323814] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6e403189-fcac-40e3-aa50-4c17f4d29895 in Status: IN_PROGRESS for 2s [ 1117.102212] env[65306]: INFO networking_nsxv3.common.synchronization [req-c92bfbfc-e97c-4015-a0b8-be55a2054152 req-9ea37606-67f7-4329-9c8f-e2a60db8c1d2 tempest-ServersTestJSON-1773114292 tempest-ServersTestJSON-1773114292-project-member] Enqueued Resource ID: 0cb41b0f-cdd2-4222-95b4-bafd614b7460 with Priority: HIGHEST for action security_group_members [ 1117.102823] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0cb41b0f-cdd2-4222-95b4-bafd614b7460 with Priority: HIGHEST for action security_group_members [ 1117.103177] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-0cb41b0f-cdd2-4222-95b4-bafd614b7460 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.103314] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0cb41b0f-cdd2-4222-95b4-bafd614b7460" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.103410] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0cb41b0f-cdd2-4222-95b4-bafd614b7460" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.103645] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0cb41b0f-cdd2-4222-95b4-bafd614b7460" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.103809] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.103929] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.103998] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.104179] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.104269] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.104399] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0cb41b0f-cdd2-4222-95b4-bafd614b7460',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1117.608434] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0cb41b0f-cdd2-4222-95b4-bafd614b7460',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1118.111894] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0cb41b0f-cdd2-4222-95b4-bafd614b7460',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1118.153033] env[65306]: INFO networking_nsxv3.common.synchronization [None req-95fed116-3163-4c46-9765-cba9a789ce78 tempest-AttachVolumeNegativeTest-723798471 tempest-AttachVolumeNegativeTest-723798471-project-member] Enqueued Resource ID: 52d329d0-14c2-4610-ad32-9ade5237bab0 with Priority: HIGHEST for action security_group_rules [ 1118.153033] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 52d329d0-14c2-4610-ad32-9ade5237bab0 with Priority: HIGHEST for action security_group_rules [ 1118.153033] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock rules-52d329d0-14c2-4610-ad32-9ade5237bab0 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.153033] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-52d329d0-14c2-4610-ad32-9ade5237bab0" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.153519] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-52d329d0-14c2-4610-ad32-9ade5237bab0" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.159661] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-52d329d0-14c2-4610-ad32-9ade5237bab0" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.159661] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('52d329d0-14c2-4610-ad32-9ade5237bab0',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1118.235185] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4603b17e-9032-4f9f-a8ac-9d7d5e34db46 in Status: SUCCESS [ 1118.235185] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4603b17e-9032-4f9f-a8ac-9d7d5e34db46" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.275359] env[65306]: INFO networking_nsxv3.common.synchronization [None req-89e5cb7d-f2c5-4f2b-ae2a-13639f5fab3b tempest-AttachVolumeNegativeTest-723798471 tempest-AttachVolumeNegativeTest-723798471-project-member] Enqueued Resource ID: 52d329d0-14c2-4610-ad32-9ade5237bab0 with Priority: HIGHEST for action security_group_rules [ 1118.276032] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 52d329d0-14c2-4610-ad32-9ade5237bab0 with Priority: HIGHEST for action security_group_rules [ 1118.276032] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock rules-52d329d0-14c2-4610-ad32-9ade5237bab0 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.276610] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-52d329d0-14c2-4610-ad32-9ade5237bab0" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.336943] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6e403189-fcac-40e3-aa50-4c17f4d29895 in Status: SUCCESS [ 1118.337233] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6e403189-fcac-40e3-aa50-4c17f4d29895" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.337412] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6e403189-fcac-40e3-aa50-4c17f4d29895" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.337639] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6e403189-fcac-40e3-aa50-4c17f4d29895" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.337998] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.337998] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.337998] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.338164] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.338243] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.338320] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6e403189-fcac-40e3-aa50-4c17f4d29895" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.338408] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6e403189-fcac-40e3-aa50-4c17f4d29895',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1118.615792] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.616041] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.616122] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.616345] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.616437] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.616542] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0cb41b0f-cdd2-4222-95b4-bafd614b7460 is going to be updated. [ 1118.662986] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.663218] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.663319] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.663639] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.663845] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.682262] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0cb41b0f-cdd2-4222-95b4-bafd614b7460 in Status: IN_PROGRESS for 2s [ 1118.687706] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.687706] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.687706] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.688090] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.688991] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.688991] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 52d329d0-14c2-4610-ad32-9ade5237bab0 already deleted. [ 1118.688991] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-52d329d0-14c2-4610-ad32-9ade5237bab0" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.688991] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-52d329d0-14c2-4610-ad32-9ade5237bab0" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.689408] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-52d329d0-14c2-4610-ad32-9ade5237bab0" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.689538] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('52d329d0-14c2-4610-ad32-9ade5237bab0',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1118.841292] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6e403189-fcac-40e3-aa50-4c17f4d29895',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1119.211602] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.212061] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.212061] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.212061] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.212211] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.212211] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 52d329d0-14c2-4610-ad32-9ade5237bab0 already deleted. [ 1119.212302] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-52d329d0-14c2-4610-ad32-9ade5237bab0" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.344793] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6e403189-fcac-40e3-aa50-4c17f4d29895: rpc.has_security_group_logging(os_id): False [ 1119.366159] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.366159] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.366159] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.366159] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.366159] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.366159] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.366473] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.366473] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.366533] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.366615] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.366705] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6e403189-fcac-40e3-aa50-4c17f4d29895 is going to be updated. [ 1119.449540] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.449659] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.449847] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.449968] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.450143] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.464311] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6e403189-fcac-40e3-aa50-4c17f4d29895 in Status: IN_PROGRESS for 2s [ 1119.901313] env[65306]: INFO networking_nsxv3.common.synchronization [req-25698f0a-eb8f-47d7-8054-8f84dab92370 req-947393d2-7053-4434-bac1-e7d9897ee2e8 tempest-ServerDiskConfigTestJSON-771154958 tempest-ServerDiskConfigTestJSON-771154958-project-member] Enqueued Resource ID: 9e80329d-1fcd-4c50-8991-a90e2a1fbdbc with Priority: HIGHEST for action security_group_members [ 1119.901313] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9e80329d-1fcd-4c50-8991-a90e2a1fbdbc with Priority: HIGHEST for action security_group_members [ 1119.901313] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-9e80329d-1fcd-4c50-8991-a90e2a1fbdbc taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.901313] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9e80329d-1fcd-4c50-8991-a90e2a1fbdbc" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.901313] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9e80329d-1fcd-4c50-8991-a90e2a1fbdbc" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.901313] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9e80329d-1fcd-4c50-8991-a90e2a1fbdbc" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.901313] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.901313] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.901313] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.901313] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.901313] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.902314] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9e80329d-1fcd-4c50-8991-a90e2a1fbdbc',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1120.367990] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock network-681 taken with stack trace [, , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.368330] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "network-681" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.368420] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "network-681" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.368703] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "network-681" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.368963] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.369294] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.369480] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.369709] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.369904] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.370236] env[65306]: DEBUG dogpile.cache.region [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] No value present for key: 'zone-id' {{(pid=65306) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1120.370396] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] NeedRegenerationException {{(pid=65306) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1120.370539] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] no value, waiting for create lock {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1120.370679] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] value creation lock acquired {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1120.370823] env[65306]: DEBUG dogpile.cache.region [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] No value present for key: 'zone-id' {{(pid=65306) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1120.371679] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Calling creation function for not-yet-present value {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1120.371679] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1120.395317] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1120.395604] env[65306]: DEBUG dogpile.cache.region [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65306) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1120.395798] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Released creation lock {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1120.395875] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "network-681" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.396265] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock port-361d4c29-c515-4887-a825-df8b25183496 taken with stack trace [, , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.396473] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "port-361d4c29-c515-4887-a825-df8b25183496" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.396713] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "port-361d4c29-c515-4887-a825-df8b25183496" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.397530] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "port-361d4c29-c515-4887-a825-df8b25183496" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.397530] env[65306]: DEBUG networking_nsxv3.api.rpc [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('361d4c29-c515-4887-a825-df8b25183496',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1120.404019] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.404019] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.404019] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.404019] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.404019] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.404274] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.404274] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.404352] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.404480] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.404595] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.404634] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9e80329d-1fcd-4c50-8991-a90e2a1fbdbc is going to be updated. [ 1120.435683] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.435912] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.435912] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.436138] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.436349] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.448203] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9e80329d-1fcd-4c50-8991-a90e2a1fbdbc in Status: IN_PROGRESS for 2s [ 1120.692134] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0cb41b0f-cdd2-4222-95b4-bafd614b7460 in Status: SUCCESS [ 1120.692379] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0cb41b0f-cdd2-4222-95b4-bafd614b7460" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.902116] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.902116] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.902116] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.902116] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.902116] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.902116] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Segment Port 361d4c29-c515-4887-a825-df8b25183496 not found, creating... [ 1120.902513] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.902569] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.902651] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.902885] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.903027] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.903307] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.903491] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.903617] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.903829] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.903956] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.906137] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Resource: SegmentPort with ID: 361d4c29-c515-4887-a825-df8b25183496 is going to be created. [ 1120.929186] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.930041] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.930231] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.930635] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.930924] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.931227] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "port-361d4c29-c515-4887-a825-df8b25183496" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.478522] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6e403189-fcac-40e3-aa50-4c17f4d29895 in Status: SUCCESS [ 1121.478827] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6e403189-fcac-40e3-aa50-4c17f4d29895" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.676729] env[65306]: INFO networking_nsxv3.common.synchronization [req-25698f0a-eb8f-47d7-8054-8f84dab92370 req-79539010-2134-4be0-8839-4b022416a990 service nova] Enqueued Resource ID: 9e80329d-1fcd-4c50-8991-a90e2a1fbdbc with Priority: HIGHEST for action security_group_rules [ 1121.677140] env[65306]: INFO networking_nsxv3.common.synchronization [req-25698f0a-eb8f-47d7-8054-8f84dab92370 req-79539010-2134-4be0-8839-4b022416a990 service nova] Enqueued Resource ID: 9e80329d-1fcd-4c50-8991-a90e2a1fbdbc with Priority: HIGHEST for action security_group_members [ 1121.677328] env[65306]: INFO networking_nsxv3.common.synchronization [req-25698f0a-eb8f-47d7-8054-8f84dab92370 req-79539010-2134-4be0-8839-4b022416a990 service nova] Enqueued Resource ID: 361d4c29-c515-4887-a825-df8b25183496 with Priority: HIGHEST for action port [ 1121.677893] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9e80329d-1fcd-4c50-8991-a90e2a1fbdbc with Priority: HIGHEST for action security_group_rules [ 1121.678032] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9e80329d-1fcd-4c50-8991-a90e2a1fbdbc with Priority: HIGHEST for action security_group_members [ 1121.678140] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 361d4c29-c515-4887-a825-df8b25183496 with Priority: HIGHEST for action port [ 1121.678799] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9e80329d-1fcd-4c50-8991-a90e2a1fbdbc taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.678799] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9e80329d-1fcd-4c50-8991-a90e2a1fbdbc" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.678799] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9e80329d-1fcd-4c50-8991-a90e2a1fbdbc" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.678985] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9e80329d-1fcd-4c50-8991-a90e2a1fbdbc" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.679037] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9e80329d-1fcd-4c50-8991-a90e2a1fbdbc',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1121.680126] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-9e80329d-1fcd-4c50-8991-a90e2a1fbdbc taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.680202] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9e80329d-1fcd-4c50-8991-a90e2a1fbdbc" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.680388] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock port-361d4c29-c515-4887-a825-df8b25183496 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.680536] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-361d4c29-c515-4887-a825-df8b25183496" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.680641] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-361d4c29-c515-4887-a825-df8b25183496" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.680989] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-361d4c29-c515-4887-a825-df8b25183496" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.680989] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('361d4c29-c515-4887-a825-df8b25183496',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1121.693250] env[65306]: INFO networking_nsxv3.common.synchronization [None req-01df0a50-634a-4f0c-8a58-81737848bbdf tempest-AttachVolumeTestJSON-1277615836 tempest-AttachVolumeTestJSON-1277615836-project-member] Enqueued Resource ID: 1b97992b-9002-4b6e-b809-d68f93354c99 with Priority: HIGHEST for action security_group_rules [ 1121.693250] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1b97992b-9002-4b6e-b809-d68f93354c99 with Priority: HIGHEST for action security_group_rules [ 1121.693250] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1b97992b-9002-4b6e-b809-d68f93354c99 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.693250] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1b97992b-9002-4b6e-b809-d68f93354c99" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.693250] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1b97992b-9002-4b6e-b809-d68f93354c99" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.696124] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1b97992b-9002-4b6e-b809-d68f93354c99" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.696821] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1b97992b-9002-4b6e-b809-d68f93354c99',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1121.823183] env[65306]: INFO networking_nsxv3.common.synchronization [None req-42c212a3-0c22-4c32-af39-8733891e7e0b tempest-AttachVolumeTestJSON-1277615836 tempest-AttachVolumeTestJSON-1277615836-project-member] Enqueued Resource ID: 1b97992b-9002-4b6e-b809-d68f93354c99 with Priority: HIGHEST for action security_group_rules [ 1121.823183] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1b97992b-9002-4b6e-b809-d68f93354c99 with Priority: HIGHEST for action security_group_rules [ 1121.823183] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1b97992b-9002-4b6e-b809-d68f93354c99 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.823183] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1b97992b-9002-4b6e-b809-d68f93354c99" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.183261] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-9e80329d-1fcd-4c50-8991-a90e2a1fbdbc taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.184026] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9e80329d-1fcd-4c50-8991-a90e2a1fbdbc" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.184203] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 361d4c29-c515-4887-a825-df8b25183496 with status ACTIVE [ 1122.185036] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.185036] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.185036] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.185036] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.185036] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.185409] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.185521] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.185591] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.185780] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.185880] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.186097] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.186192] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.186296] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.186766] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.186766] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.186766] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 361d4c29-c515-4887-a825-df8b25183496 is going to be updated. [ 1122.213496] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.213754] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.213814] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.214052] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.214216] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.214386] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-361d4c29-c515-4887-a825-df8b25183496" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.226569] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.226737] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.226737] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.226962] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.227035] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.227458] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1b97992b-9002-4b6e-b809-d68f93354c99 already deleted. [ 1122.227458] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1b97992b-9002-4b6e-b809-d68f93354c99" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.227885] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1b97992b-9002-4b6e-b809-d68f93354c99" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.228243] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1b97992b-9002-4b6e-b809-d68f93354c99" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.228243] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1b97992b-9002-4b6e-b809-d68f93354c99',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1122.301597] env[65306]: INFO networking_nsxv3.common.synchronization [req-406ed46d-0777-4065-bb04-21623167cc55 req-124ec3f9-c30f-4422-be4c-f02a28df0ac6 tempest-ImagesOneServerTestJSON-691374835 tempest-ImagesOneServerTestJSON-691374835-project-member] Enqueued Resource ID: 1dfcba8d-33df-4f0e-919e-4904bde851ad with Priority: HIGHEST for action security_group_members [ 1122.302321] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1dfcba8d-33df-4f0e-919e-4904bde851ad with Priority: HIGHEST for action security_group_members [ 1122.302892] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-1dfcba8d-33df-4f0e-919e-4904bde851ad taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.303351] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1dfcba8d-33df-4f0e-919e-4904bde851ad" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.303458] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1dfcba8d-33df-4f0e-919e-4904bde851ad" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.303794] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1dfcba8d-33df-4f0e-919e-4904bde851ad" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.303975] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.304111] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.304292] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.304417] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.304417] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.304556] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1dfcba8d-33df-4f0e-919e-4904bde851ad',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1122.458732] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9e80329d-1fcd-4c50-8991-a90e2a1fbdbc in Status: SUCCESS [ 1122.459045] env[65306]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9e80329d-1fcd-4c50-8991-a90e2a1fbdbc deletion is rescheduled due to dependency. [ 1122.459144] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9e80329d-1fcd-4c50-8991-a90e2a1fbdbc" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.459299] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9e80329d-1fcd-4c50-8991-a90e2a1fbdbc" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.459545] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9e80329d-1fcd-4c50-8991-a90e2a1fbdbc" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.459757] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.459904] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.459975] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.460165] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.460263] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.460378] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9e80329d-1fcd-4c50-8991-a90e2a1fbdbc',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1122.689824] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock network-453 taken with stack trace [, , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.690313] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "network-453" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.690313] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "network-453" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.690465] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "network-453" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.690717] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.690875] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.690992] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.691570] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.691763] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.691988] env[65306]: DEBUG dogpile.cache.region [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] No value present for key: 'zone-id' {{(pid=65306) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1122.692120] env[65306]: DEBUG dogpile.lock [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] NeedRegenerationException {{(pid=65306) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1122.692232] env[65306]: DEBUG dogpile.lock [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] no value, waiting for create lock {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1122.692342] env[65306]: DEBUG dogpile.lock [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] value creation lock acquired {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1122.692456] env[65306]: DEBUG dogpile.cache.region [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] No value present for key: 'zone-id' {{(pid=65306) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1122.692564] env[65306]: DEBUG dogpile.lock [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Calling creation function for not-yet-present value {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1122.692697] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1122.713495] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1122.713675] env[65306]: DEBUG dogpile.cache.region [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65306) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1122.713834] env[65306]: DEBUG dogpile.lock [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Released creation lock {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1122.714064] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "network-453" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.714382] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock port-6c07c2dc-50f7-4d7a-b0d2-1e586dd69345 taken with stack trace [, , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.714579] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "port-6c07c2dc-50f7-4d7a-b0d2-1e586dd69345" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.714685] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "port-6c07c2dc-50f7-4d7a-b0d2-1e586dd69345" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.715013] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "port-6c07c2dc-50f7-4d7a-b0d2-1e586dd69345" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.715157] env[65306]: DEBUG networking_nsxv3.api.rpc [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6c07c2dc-50f7-4d7a-b0d2-1e586dd69345',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1122.748761] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.749036] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.749036] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.749222] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.749337] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.749434] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1b97992b-9002-4b6e-b809-d68f93354c99 already deleted. [ 1122.749521] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1b97992b-9002-4b6e-b809-d68f93354c99" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.806338] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.806549] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.806549] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.806770] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.806858] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.807063] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.807172] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.807229] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.807379] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.807457] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.807548] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1dfcba8d-33df-4f0e-919e-4904bde851ad already deleted. [ 1122.807628] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1dfcba8d-33df-4f0e-919e-4904bde851ad" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.962655] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9e80329d-1fcd-4c50-8991-a90e2a1fbdbc',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1123.218056] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.218307] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.218440] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.218729] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.218885] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.219058] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Segment Port 6c07c2dc-50f7-4d7a-b0d2-1e586dd69345 not found, creating... [ 1123.219323] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.219496] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.219610] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.219840] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.219976] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.220395] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.220605] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.220757] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.220999] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.221188] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.221372] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Resource: SegmentPort with ID: 6c07c2dc-50f7-4d7a-b0d2-1e586dd69345 is going to be created. [ 1123.246780] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.246780] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.246780] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.247179] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.247230] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.247640] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "port-6c07c2dc-50f7-4d7a-b0d2-1e586dd69345" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.465464] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9e80329d-1fcd-4c50-8991-a90e2a1fbdbc',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1123.936138] env[65306]: INFO networking_nsxv3.common.synchronization [req-406ed46d-0777-4065-bb04-21623167cc55 req-16cc6db1-96d6-4bf9-b3e6-4ba994dc6724 service nova] Enqueued Resource ID: 1dfcba8d-33df-4f0e-919e-4904bde851ad with Priority: HIGHEST for action security_group_rules [ 1123.936383] env[65306]: INFO networking_nsxv3.common.synchronization [req-406ed46d-0777-4065-bb04-21623167cc55 req-16cc6db1-96d6-4bf9-b3e6-4ba994dc6724 service nova] Enqueued Resource ID: 1dfcba8d-33df-4f0e-919e-4904bde851ad with Priority: HIGHEST for action security_group_members [ 1123.936459] env[65306]: INFO networking_nsxv3.common.synchronization [req-406ed46d-0777-4065-bb04-21623167cc55 req-16cc6db1-96d6-4bf9-b3e6-4ba994dc6724 service nova] Enqueued Resource ID: 6c07c2dc-50f7-4d7a-b0d2-1e586dd69345 with Priority: HIGHEST for action port [ 1123.936973] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1dfcba8d-33df-4f0e-919e-4904bde851ad with Priority: HIGHEST for action security_group_rules [ 1123.937857] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1dfcba8d-33df-4f0e-919e-4904bde851ad with Priority: HIGHEST for action security_group_members [ 1123.937857] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6c07c2dc-50f7-4d7a-b0d2-1e586dd69345 with Priority: HIGHEST for action port [ 1123.937857] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1dfcba8d-33df-4f0e-919e-4904bde851ad taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.937857] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1dfcba8d-33df-4f0e-919e-4904bde851ad" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.937857] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1dfcba8d-33df-4f0e-919e-4904bde851ad" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.938139] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1dfcba8d-33df-4f0e-919e-4904bde851ad" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.938139] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1dfcba8d-33df-4f0e-919e-4904bde851ad',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1123.940271] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-1dfcba8d-33df-4f0e-919e-4904bde851ad taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.940271] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1dfcba8d-33df-4f0e-919e-4904bde851ad" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.940271] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1dfcba8d-33df-4f0e-919e-4904bde851ad" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.941898] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1dfcba8d-33df-4f0e-919e-4904bde851ad" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.942068] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.942174] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.942241] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.946852] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.947079] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.947144] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1dfcba8d-33df-4f0e-919e-4904bde851ad',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1123.948053] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock port-6c07c2dc-50f7-4d7a-b0d2-1e586dd69345 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.948195] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6c07c2dc-50f7-4d7a-b0d2-1e586dd69345" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.948233] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6c07c2dc-50f7-4d7a-b0d2-1e586dd69345" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.949096] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6c07c2dc-50f7-4d7a-b0d2-1e586dd69345" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.949096] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6c07c2dc-50f7-4d7a-b0d2-1e586dd69345',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1123.968510] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.968510] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.968510] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.968510] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.968510] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.968510] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9e80329d-1fcd-4c50-8991-a90e2a1fbdbc is going to be updated. [ 1123.999493] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.999493] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.999493] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.999646] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.999971] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.008930] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9e80329d-1fcd-4c50-8991-a90e2a1fbdbc in Status: IN_PROGRESS for 2s [ 1124.440091] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-1dfcba8d-33df-4f0e-919e-4904bde851ad taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.440275] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1dfcba8d-33df-4f0e-919e-4904bde851ad" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.450576] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1dfcba8d-33df-4f0e-919e-4904bde851ad',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1124.451522] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6c07c2dc-50f7-4d7a-b0d2-1e586dd69345 with status ACTIVE [ 1124.451715] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.451837] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.451954] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.452157] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.452246] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.452428] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.452545] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.452606] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.452757] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.452830] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.453047] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.453306] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.453306] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.453393] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.453514] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.454069] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6c07c2dc-50f7-4d7a-b0d2-1e586dd69345 is going to be updated. [ 1124.475370] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.475537] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.475578] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.475787] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.475939] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.476125] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6c07c2dc-50f7-4d7a-b0d2-1e586dd69345" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.956146] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1dfcba8d-33df-4f0e-919e-4904bde851ad',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1125.458833] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.458945] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.459032] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.459258] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.459353] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.459862] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1dfcba8d-33df-4f0e-919e-4904bde851ad is going to be created. [ 1125.485499] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.485672] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.485709] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.485921] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.486570] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.499232] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1dfcba8d-33df-4f0e-919e-4904bde851ad in Status: UNINITIALIZED for 2s [ 1126.021194] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9e80329d-1fcd-4c50-8991-a90e2a1fbdbc in Status: SUCCESS [ 1126.021530] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9e80329d-1fcd-4c50-8991-a90e2a1fbdbc" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.021752] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9e80329d-1fcd-4c50-8991-a90e2a1fbdbc" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.022016] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9e80329d-1fcd-4c50-8991-a90e2a1fbdbc" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.022333] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.022519] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.022621] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.022808] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.022929] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.023102] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9e80329d-1fcd-4c50-8991-a90e2a1fbdbc" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.023227] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9e80329d-1fcd-4c50-8991-a90e2a1fbdbc',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1126.525319] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-9e80329d-1fcd-4c50-8991-a90e2a1fbdbc taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.525639] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9e80329d-1fcd-4c50-8991-a90e2a1fbdbc" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.525639] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9e80329d-1fcd-4c50-8991-a90e2a1fbdbc" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.525755] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9e80329d-1fcd-4c50-8991-a90e2a1fbdbc" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.525935] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.526060] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.526125] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.526287] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.526382] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.526475] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9e80329d-1fcd-4c50-8991-a90e2a1fbdbc" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.526627] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-9e80329d-1fcd-4c50-8991-a90e2a1fbdbc taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.526721] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9e80329d-1fcd-4c50-8991-a90e2a1fbdbc" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.526783] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9e80329d-1fcd-4c50-8991-a90e2a1fbdbc" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.526924] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9e80329d-1fcd-4c50-8991-a90e2a1fbdbc" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.527090] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.527201] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.527264] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.527454] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.527547] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.527633] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9e80329d-1fcd-4c50-8991-a90e2a1fbdbc" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.527725] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9e80329d-1fcd-4c50-8991-a90e2a1fbdbc',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1126.942171] env[65306]: INFO networking_nsxv3.common.synchronization [req-48df0051-934e-453a-9e87-e0b4b18c6d34 req-ba75318c-b781-4a47-b97c-55d0f8c6cc0c tempest-ServerActionsTestOtherB-1027609472 tempest-ServerActionsTestOtherB-1027609472-project-member] Enqueued Resource ID: 37349b8b-c2c1-4141-8b10-752c27492cbd with Priority: HIGHEST for action security_group_members [ 1126.943965] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 37349b8b-c2c1-4141-8b10-752c27492cbd with Priority: HIGHEST for action security_group_members [ 1126.943965] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-37349b8b-c2c1-4141-8b10-752c27492cbd taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.943965] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-37349b8b-c2c1-4141-8b10-752c27492cbd" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.943965] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-37349b8b-c2c1-4141-8b10-752c27492cbd" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.944162] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-37349b8b-c2c1-4141-8b10-752c27492cbd" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.944350] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.944421] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.944522] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.944789] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.944979] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.945183] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('37349b8b-c2c1-4141-8b10-752c27492cbd',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1127.030737] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9e80329d-1fcd-4c50-8991-a90e2a1fbdbc: rpc.has_security_group_logging(os_id): False [ 1127.049477] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.049717] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.049800] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.050015] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.050120] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.050350] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.050457] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.050523] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.050670] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.050778] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.050966] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.051075] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.051136] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.051280] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.051352] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.051545] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.051653] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.051714] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.051859] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.051938] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.052060] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9e80329d-1fcd-4c50-8991-a90e2a1fbdbc is going to be updated. [ 1127.121027] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.122346] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.122346] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.122346] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.122346] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.134759] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9e80329d-1fcd-4c50-8991-a90e2a1fbdbc in Status: IN_PROGRESS for 2s [ 1127.397184] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock network-221 taken with stack trace [, , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.397294] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "network-221" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.397457] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "network-221" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.397802] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "network-221" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.398380] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.398568] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.399251] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.399251] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.399251] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.399454] env[65306]: DEBUG dogpile.cache.region [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] No value present for key: 'zone-id' {{(pid=65306) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1127.399620] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] NeedRegenerationException {{(pid=65306) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1127.399788] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] no value, waiting for create lock {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1127.399910] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] value creation lock acquired {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1127.400342] env[65306]: DEBUG dogpile.cache.region [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] No value present for key: 'zone-id' {{(pid=65306) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1127.400530] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Calling creation function for not-yet-present value {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1127.400715] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1127.428682] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1127.428885] env[65306]: DEBUG dogpile.cache.region [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Cache value generated in 0.028 seconds for key(s): 'zone-id' {{(pid=65306) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1127.429047] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Released creation lock {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1127.429408] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "network-221" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.429590] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock port-0936ac13-cee3-42ed-834c-377791127339 taken with stack trace [, , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.429788] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "port-0936ac13-cee3-42ed-834c-377791127339" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.429913] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "port-0936ac13-cee3-42ed-834c-377791127339" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.430279] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "port-0936ac13-cee3-42ed-834c-377791127339" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.430441] env[65306]: DEBUG networking_nsxv3.api.rpc [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0936ac13-cee3-42ed-834c-377791127339',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1127.448187] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.448378] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.448550] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.448658] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.448753] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.449999] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.449999] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.449999] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.449999] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.449999] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.449999] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 37349b8b-c2c1-4141-8b10-752c27492cbd is going to be updated. [ 1127.485576] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.485796] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.485796] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.486038] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.486187] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.497663] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 37349b8b-c2c1-4141-8b10-752c27492cbd in Status: IN_PROGRESS for 2s [ 1127.511480] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1dfcba8d-33df-4f0e-919e-4904bde851ad in Status: SUCCESS [ 1127.511480] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1dfcba8d-33df-4f0e-919e-4904bde851ad" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.511748] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1dfcba8d-33df-4f0e-919e-4904bde851ad" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.512094] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1dfcba8d-33df-4f0e-919e-4904bde851ad" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.512292] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.512435] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.512508] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.512694] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.512782] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.513082] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1dfcba8d-33df-4f0e-919e-4904bde851ad" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.513082] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1dfcba8d-33df-4f0e-919e-4904bde851ad',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1127.933377] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.933671] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.933815] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.934112] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.934266] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.934424] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Segment Port 0936ac13-cee3-42ed-834c-377791127339 not found, creating... [ 1127.935030] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.935030] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.935030] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.935235] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.935320] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.935593] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.935745] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.935884] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.936197] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.936339] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.936482] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Resource: SegmentPort with ID: 0936ac13-cee3-42ed-834c-377791127339 is going to be created. [ 1127.956555] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.956788] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.956890] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.957220] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.957475] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.957713] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "port-0936ac13-cee3-42ed-834c-377791127339" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.016476] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-1dfcba8d-33df-4f0e-919e-4904bde851ad taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.016835] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1dfcba8d-33df-4f0e-919e-4904bde851ad" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.016835] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1dfcba8d-33df-4f0e-919e-4904bde851ad" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.020168] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1dfcba8d-33df-4f0e-919e-4904bde851ad" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.020168] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.020168] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.020168] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.020168] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.020168] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.020168] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1dfcba8d-33df-4f0e-919e-4904bde851ad" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.020168] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-1dfcba8d-33df-4f0e-919e-4904bde851ad taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.020168] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1dfcba8d-33df-4f0e-919e-4904bde851ad" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.020168] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1dfcba8d-33df-4f0e-919e-4904bde851ad" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.020168] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1dfcba8d-33df-4f0e-919e-4904bde851ad" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.020168] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.020168] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.020168] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.020168] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.020168] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.020168] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1dfcba8d-33df-4f0e-919e-4904bde851ad" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.020168] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1dfcba8d-33df-4f0e-919e-4904bde851ad',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1128.521192] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1dfcba8d-33df-4f0e-919e-4904bde851ad: rpc.has_security_group_logging(os_id): False [ 1128.539265] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.540712] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.540954] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.541236] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.541442] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.541755] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.541939] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.542059] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.542288] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.542413] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.542659] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.542814] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.542933] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.543110] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.543235] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.543491] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.543689] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.543823] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.544025] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.544154] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.544283] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1dfcba8d-33df-4f0e-919e-4904bde851ad is going to be created. [ 1128.607418] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.607809] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.607937] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.608209] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.608470] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.623608] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1dfcba8d-33df-4f0e-919e-4904bde851ad in Status: IN_PROGRESS for 2s [ 1128.644361] env[65306]: INFO networking_nsxv3.common.synchronization [req-48df0051-934e-453a-9e87-e0b4b18c6d34 req-957dfd5b-303b-4821-822d-e33b1f34f5c3 service nova] Enqueued Resource ID: 37349b8b-c2c1-4141-8b10-752c27492cbd with Priority: HIGHEST for action security_group_rules [ 1128.644481] env[65306]: INFO networking_nsxv3.common.synchronization [req-48df0051-934e-453a-9e87-e0b4b18c6d34 req-957dfd5b-303b-4821-822d-e33b1f34f5c3 service nova] Enqueued Resource ID: 37349b8b-c2c1-4141-8b10-752c27492cbd with Priority: HIGHEST for action security_group_members [ 1128.644651] env[65306]: INFO networking_nsxv3.common.synchronization [req-48df0051-934e-453a-9e87-e0b4b18c6d34 req-957dfd5b-303b-4821-822d-e33b1f34f5c3 service nova] Enqueued Resource ID: 0936ac13-cee3-42ed-834c-377791127339 with Priority: HIGHEST for action port [ 1128.645346] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 37349b8b-c2c1-4141-8b10-752c27492cbd with Priority: HIGHEST for action security_group_rules [ 1128.645757] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 37349b8b-c2c1-4141-8b10-752c27492cbd with Priority: HIGHEST for action security_group_members [ 1128.645757] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0936ac13-cee3-42ed-834c-377791127339 with Priority: HIGHEST for action port [ 1128.646102] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock rules-37349b8b-c2c1-4141-8b10-752c27492cbd taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.646286] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-37349b8b-c2c1-4141-8b10-752c27492cbd" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.646393] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-37349b8b-c2c1-4141-8b10-752c27492cbd" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.646637] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-37349b8b-c2c1-4141-8b10-752c27492cbd" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.646771] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('37349b8b-c2c1-4141-8b10-752c27492cbd',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1128.647752] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-37349b8b-c2c1-4141-8b10-752c27492cbd taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.647907] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-37349b8b-c2c1-4141-8b10-752c27492cbd" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.648166] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock port-0936ac13-cee3-42ed-834c-377791127339 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.648327] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0936ac13-cee3-42ed-834c-377791127339" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.648433] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0936ac13-cee3-42ed-834c-377791127339" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.648818] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0936ac13-cee3-42ed-834c-377791127339" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.648818] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0936ac13-cee3-42ed-834c-377791127339',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1128.995725] env[65306]: INFO networking_nsxv3.common.synchronization [req-a0ea84e0-ae90-44f0-b638-dc297c6c15d6 req-21dd7896-23be-4052-83b5-f0b35bcf40a9 tempest-AttachVolumeNegativeTest-723798471 tempest-AttachVolumeNegativeTest-723798471-project-member] Enqueued Resource ID: 52d329d0-14c2-4610-ad32-9ade5237bab0 with Priority: HIGHEST for action security_group_members [ 1128.996285] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 52d329d0-14c2-4610-ad32-9ade5237bab0 with Priority: HIGHEST for action security_group_members [ 1128.996657] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-52d329d0-14c2-4610-ad32-9ade5237bab0 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.996857] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-52d329d0-14c2-4610-ad32-9ade5237bab0" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.996968] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-52d329d0-14c2-4610-ad32-9ade5237bab0" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.997279] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-52d329d0-14c2-4610-ad32-9ade5237bab0" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.997535] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.997696] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.997772] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.998136] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.998240] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.998360] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('52d329d0-14c2-4610-ad32-9ade5237bab0',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1129.150925] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9e80329d-1fcd-4c50-8991-a90e2a1fbdbc in Status: SUCCESS [ 1129.150925] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9e80329d-1fcd-4c50-8991-a90e2a1fbdbc" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.155026] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-37349b8b-c2c1-4141-8b10-752c27492cbd taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.155026] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-37349b8b-c2c1-4141-8b10-752c27492cbd" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.155026] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0936ac13-cee3-42ed-834c-377791127339 with status ACTIVE [ 1129.155026] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.155026] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.155026] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.155026] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.155026] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.155026] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.155026] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.155026] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.155026] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.155026] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.155026] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.155722] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.155722] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.155722] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.155722] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.155722] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0936ac13-cee3-42ed-834c-377791127339 is going to be updated. [ 1129.181962] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.181962] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.181962] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.181962] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.181962] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.181962] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0936ac13-cee3-42ed-834c-377791127339" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.365722] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock network-638 taken with stack trace [, , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.365868] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "network-638" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.365910] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "network-638" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.366292] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "network-638" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.366871] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.367115] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.367284] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.367494] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.367641] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.368834] env[65306]: DEBUG dogpile.cache.region [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] No value present for key: 'zone-id' {{(pid=65306) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1129.368834] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] NeedRegenerationException {{(pid=65306) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1129.368834] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] no value, waiting for create lock {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1129.368834] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] value creation lock acquired {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1129.368834] env[65306]: DEBUG dogpile.cache.region [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] No value present for key: 'zone-id' {{(pid=65306) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1129.368834] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Calling creation function for not-yet-present value {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1129.368834] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1129.391202] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1129.391482] env[65306]: DEBUG dogpile.cache.region [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65306) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1129.391695] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Released creation lock {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1129.391794] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "network-638" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.392063] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock port-128553ba-5e81-412f-8e65-36b46e4346d5 taken with stack trace [, , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.392281] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "port-128553ba-5e81-412f-8e65-36b46e4346d5" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.392381] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "port-128553ba-5e81-412f-8e65-36b46e4346d5" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.392769] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "port-128553ba-5e81-412f-8e65-36b46e4346d5" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.392868] env[65306]: DEBUG networking_nsxv3.api.rpc [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('128553ba-5e81-412f-8e65-36b46e4346d5',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1129.501105] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.501460] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.501460] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.501659] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.501737] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.501978] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.502176] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.502176] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.502382] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.502544] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.502599] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 52d329d0-14c2-4610-ad32-9ade5237bab0 already deleted. [ 1129.502683] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-52d329d0-14c2-4610-ad32-9ade5237bab0" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.511473] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 37349b8b-c2c1-4141-8b10-752c27492cbd in Status: SUCCESS [ 1129.512467] env[65306]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 37349b8b-c2c1-4141-8b10-752c27492cbd deletion is rescheduled due to dependency. [ 1129.512467] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-37349b8b-c2c1-4141-8b10-752c27492cbd" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.512467] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-37349b8b-c2c1-4141-8b10-752c27492cbd" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.512467] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-37349b8b-c2c1-4141-8b10-752c27492cbd" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.512467] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.512467] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.512743] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.512743] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.512798] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.512908] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('37349b8b-c2c1-4141-8b10-752c27492cbd',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1129.895071] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.895420] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.895420] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.895756] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.895908] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.896075] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Segment Port 128553ba-5e81-412f-8e65-36b46e4346d5 not found, creating... [ 1129.896339] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.896778] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.896778] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.896872] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.896954] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.897253] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.897412] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.897528] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.898300] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.898300] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.898300] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Resource: SegmentPort with ID: 128553ba-5e81-412f-8e65-36b46e4346d5 is going to be created. [ 1129.919204] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.919494] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.919625] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.919891] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.920137] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.920364] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "port-128553ba-5e81-412f-8e65-36b46e4346d5" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.015302] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('37349b8b-c2c1-4141-8b10-752c27492cbd',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1130.517670] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('37349b8b-c2c1-4141-8b10-752c27492cbd',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1130.636867] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1dfcba8d-33df-4f0e-919e-4904bde851ad in Status: SUCCESS [ 1130.637130] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1dfcba8d-33df-4f0e-919e-4904bde851ad" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.019894] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.020239] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.020239] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.020473] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.020573] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.020700] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 37349b8b-c2c1-4141-8b10-752c27492cbd is going to be updated. [ 1131.049815] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.050034] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.050137] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.050431] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.050704] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.061267] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 37349b8b-c2c1-4141-8b10-752c27492cbd in Status: IN_PROGRESS for 2s [ 1131.093889] env[65306]: INFO networking_nsxv3.common.synchronization [req-a0ea84e0-ae90-44f0-b638-dc297c6c15d6 req-826f6363-9723-4c8e-b92a-95fbf006a15c service nova] Enqueued Resource ID: 52d329d0-14c2-4610-ad32-9ade5237bab0 with Priority: HIGHEST for action security_group_rules [ 1131.096177] env[65306]: INFO networking_nsxv3.common.synchronization [req-a0ea84e0-ae90-44f0-b638-dc297c6c15d6 req-826f6363-9723-4c8e-b92a-95fbf006a15c service nova] Enqueued Resource ID: 52d329d0-14c2-4610-ad32-9ade5237bab0 with Priority: HIGHEST for action security_group_members [ 1131.096422] env[65306]: INFO networking_nsxv3.common.synchronization [req-a0ea84e0-ae90-44f0-b638-dc297c6c15d6 req-826f6363-9723-4c8e-b92a-95fbf006a15c service nova] Enqueued Resource ID: 128553ba-5e81-412f-8e65-36b46e4346d5 with Priority: HIGHEST for action port [ 1131.097112] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 52d329d0-14c2-4610-ad32-9ade5237bab0 with Priority: HIGHEST for action security_group_rules [ 1131.097304] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 52d329d0-14c2-4610-ad32-9ade5237bab0 with Priority: HIGHEST for action security_group_members [ 1131.097443] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 128553ba-5e81-412f-8e65-36b46e4346d5 with Priority: HIGHEST for action port [ 1131.097814] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock rules-52d329d0-14c2-4610-ad32-9ade5237bab0 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.097967] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-52d329d0-14c2-4610-ad32-9ade5237bab0" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.098089] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-52d329d0-14c2-4610-ad32-9ade5237bab0" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.098366] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-52d329d0-14c2-4610-ad32-9ade5237bab0" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.098488] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('52d329d0-14c2-4610-ad32-9ade5237bab0',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1131.099592] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-52d329d0-14c2-4610-ad32-9ade5237bab0 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.099713] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-52d329d0-14c2-4610-ad32-9ade5237bab0" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.099812] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-52d329d0-14c2-4610-ad32-9ade5237bab0" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.100037] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-52d329d0-14c2-4610-ad32-9ade5237bab0" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.100243] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.100375] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.100477] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.100671] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.100803] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.100934] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('52d329d0-14c2-4610-ad32-9ade5237bab0',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1131.105355] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock port-128553ba-5e81-412f-8e65-36b46e4346d5 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.105540] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-128553ba-5e81-412f-8e65-36b46e4346d5" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.105644] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-128553ba-5e81-412f-8e65-36b46e4346d5" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.105902] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-128553ba-5e81-412f-8e65-36b46e4346d5" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.106410] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('128553ba-5e81-412f-8e65-36b46e4346d5',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1131.280604] env[65306]: INFO networking_nsxv3.common.synchronization [req-6221b5c5-b426-4d4c-a52a-3051d78459b9 req-58807530-e4b9-4be4-8909-5fcb6a25ed97 tempest-AttachVolumeTestJSON-1277615836 tempest-AttachVolumeTestJSON-1277615836-project-member] Enqueued Resource ID: 1b97992b-9002-4b6e-b809-d68f93354c99 with Priority: HIGHEST for action security_group_members [ 1131.281347] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1b97992b-9002-4b6e-b809-d68f93354c99 with Priority: HIGHEST for action security_group_members [ 1131.283787] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-1b97992b-9002-4b6e-b809-d68f93354c99 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.283787] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1b97992b-9002-4b6e-b809-d68f93354c99" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.283787] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1b97992b-9002-4b6e-b809-d68f93354c99" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.283787] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1b97992b-9002-4b6e-b809-d68f93354c99" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.283787] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.283787] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.283787] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.283787] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.283787] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.283787] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1b97992b-9002-4b6e-b809-d68f93354c99',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1131.608077] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-52d329d0-14c2-4610-ad32-9ade5237bab0 taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.608077] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-52d329d0-14c2-4610-ad32-9ade5237bab0" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.611684] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('52d329d0-14c2-4610-ad32-9ade5237bab0',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1131.611684] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 128553ba-5e81-412f-8e65-36b46e4346d5 with status ACTIVE [ 1131.611684] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.611684] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.611684] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.611684] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.611684] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.611684] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.612164] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.612164] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.612164] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.612164] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.612283] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.613087] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.613087] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.613087] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.613087] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.613087] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 128553ba-5e81-412f-8e65-36b46e4346d5 is going to be updated. [ 1131.639229] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.639434] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.639434] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.640358] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.640358] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.640358] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-128553ba-5e81-412f-8e65-36b46e4346d5" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.671413] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock network-802 taken with stack trace [, , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.671706] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "network-802" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.671913] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "network-802" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.672424] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "network-802" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.672731] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.672967] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.673171] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.673516] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.673762] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.674130] env[65306]: DEBUG dogpile.cache.region [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] No value present for key: 'zone-id' {{(pid=65306) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1131.674331] env[65306]: DEBUG dogpile.lock [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] NeedRegenerationException {{(pid=65306) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1131.674531] env[65306]: DEBUG dogpile.lock [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] no value, waiting for create lock {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1131.674727] env[65306]: DEBUG dogpile.lock [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] value creation lock acquired {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1131.674946] env[65306]: DEBUG dogpile.cache.region [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] No value present for key: 'zone-id' {{(pid=65306) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1131.675178] env[65306]: DEBUG dogpile.lock [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Calling creation function for not-yet-present value {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1131.675403] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1131.696040] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1131.696040] env[65306]: DEBUG dogpile.cache.region [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65306) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1131.696250] env[65306]: DEBUG dogpile.lock [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Released creation lock {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1131.696250] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "network-802" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.697405] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock port-ebdec675-da09-49d6-9599-889f6a9a5980 taken with stack trace [, , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.697405] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "port-ebdec675-da09-49d6-9599-889f6a9a5980" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.697405] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "port-ebdec675-da09-49d6-9599-889f6a9a5980" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.697405] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "port-ebdec675-da09-49d6-9599-889f6a9a5980" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.697405] env[65306]: DEBUG networking_nsxv3.api.rpc [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ebdec675-da09-49d6-9599-889f6a9a5980',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1131.786093] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.786398] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.786521] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.786861] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.787042] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.787356] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.787526] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.787649] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.787915] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.788048] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.788219] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1b97992b-9002-4b6e-b809-d68f93354c99 already deleted. [ 1131.788336] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1b97992b-9002-4b6e-b809-d68f93354c99" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.115725] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('52d329d0-14c2-4610-ad32-9ade5237bab0',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1132.199845] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.200156] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.200272] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.200576] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.200784] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.200989] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Segment Port ebdec675-da09-49d6-9599-889f6a9a5980 not found, creating... [ 1132.201298] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.201510] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.201769] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.201895] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.202057] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.202390] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.202576] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.202707] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.202933] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.203158] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.203327] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Resource: SegmentPort with ID: ebdec675-da09-49d6-9599-889f6a9a5980 is going to be created. [ 1132.224622] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.225121] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.225121] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.225470] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.225728] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.226163] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "port-ebdec675-da09-49d6-9599-889f6a9a5980" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.619513] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.619749] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.619749] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.620033] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.620894] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.621021] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 52d329d0-14c2-4610-ad32-9ade5237bab0 is going to be created. [ 1132.650026] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.650174] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.650246] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.650452] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.650656] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.662417] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 52d329d0-14c2-4610-ad32-9ade5237bab0 in Status: UNINITIALIZED for 2s [ 1132.985563] env[65306]: INFO networking_nsxv3.common.synchronization [req-6221b5c5-b426-4d4c-a52a-3051d78459b9 req-c0b0f926-93ae-4f9a-8be8-5b73ce7c06fa service nova] Enqueued Resource ID: 1b97992b-9002-4b6e-b809-d68f93354c99 with Priority: HIGHEST for action security_group_rules [ 1132.985751] env[65306]: INFO networking_nsxv3.common.synchronization [req-6221b5c5-b426-4d4c-a52a-3051d78459b9 req-c0b0f926-93ae-4f9a-8be8-5b73ce7c06fa service nova] Enqueued Resource ID: 1b97992b-9002-4b6e-b809-d68f93354c99 with Priority: HIGHEST for action security_group_members [ 1132.985932] env[65306]: INFO networking_nsxv3.common.synchronization [req-6221b5c5-b426-4d4c-a52a-3051d78459b9 req-c0b0f926-93ae-4f9a-8be8-5b73ce7c06fa service nova] Enqueued Resource ID: ebdec675-da09-49d6-9599-889f6a9a5980 with Priority: HIGHEST for action port [ 1132.986467] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1b97992b-9002-4b6e-b809-d68f93354c99 with Priority: HIGHEST for action security_group_rules [ 1132.986606] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1b97992b-9002-4b6e-b809-d68f93354c99 with Priority: HIGHEST for action security_group_members [ 1132.986704] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ebdec675-da09-49d6-9599-889f6a9a5980 with Priority: HIGHEST for action port [ 1132.987125] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1b97992b-9002-4b6e-b809-d68f93354c99 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.987224] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1b97992b-9002-4b6e-b809-d68f93354c99" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.987273] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1b97992b-9002-4b6e-b809-d68f93354c99" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.987442] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1b97992b-9002-4b6e-b809-d68f93354c99" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.987528] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1b97992b-9002-4b6e-b809-d68f93354c99',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1132.988865] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-1b97992b-9002-4b6e-b809-d68f93354c99 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.988965] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1b97992b-9002-4b6e-b809-d68f93354c99" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.989034] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1b97992b-9002-4b6e-b809-d68f93354c99" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.989171] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1b97992b-9002-4b6e-b809-d68f93354c99" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.989318] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.990010] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.990010] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.990010] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.990010] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.990010] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1b97992b-9002-4b6e-b809-d68f93354c99',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1132.991915] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock port-ebdec675-da09-49d6-9599-889f6a9a5980 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.992051] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ebdec675-da09-49d6-9599-889f6a9a5980" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.992157] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ebdec675-da09-49d6-9599-889f6a9a5980" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.992288] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ebdec675-da09-49d6-9599-889f6a9a5980" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.992366] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ebdec675-da09-49d6-9599-889f6a9a5980',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1133.073850] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 37349b8b-c2c1-4141-8b10-752c27492cbd in Status: SUCCESS [ 1133.073850] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-37349b8b-c2c1-4141-8b10-752c27492cbd" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.073850] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-37349b8b-c2c1-4141-8b10-752c27492cbd" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.073850] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-37349b8b-c2c1-4141-8b10-752c27492cbd" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.073850] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.073850] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.073850] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.074381] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.074381] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.074381] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-37349b8b-c2c1-4141-8b10-752c27492cbd" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.074532] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('37349b8b-c2c1-4141-8b10-752c27492cbd',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1133.492322] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1b97992b-9002-4b6e-b809-d68f93354c99',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1133.495099] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ebdec675-da09-49d6-9599-889f6a9a5980 with status ACTIVE [ 1133.495099] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.495261] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.495261] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.496054] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.496054] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.496054] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.496054] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.496261] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.496303] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.496359] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.496548] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.496650] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.496709] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.496847] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.496917] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.497009] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ebdec675-da09-49d6-9599-889f6a9a5980 is going to be updated. [ 1133.498231] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-1b97992b-9002-4b6e-b809-d68f93354c99 taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.498347] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1b97992b-9002-4b6e-b809-d68f93354c99" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.521962] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.522139] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.522213] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.522697] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.522697] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.522770] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ebdec675-da09-49d6-9599-889f6a9a5980" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.576937] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('37349b8b-c2c1-4141-8b10-752c27492cbd',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1133.981897] env[65306]: INFO networking_nsxv3.common.synchronization [req-688453e5-0b8d-4d14-9039-34301f2660b9 req-258e2aee-b34a-47eb-9e76-ad148726bae4 tempest-DeleteServersTestJSON-1340326246 tempest-DeleteServersTestJSON-1340326246-project-member] Enqueued Resource ID: d82bad56-9830-4c7d-9763-6d8a05e0998c with Priority: HIGHEST for action security_group_members [ 1133.982653] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d82bad56-9830-4c7d-9763-6d8a05e0998c with Priority: HIGHEST for action security_group_members [ 1133.983650] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-d82bad56-9830-4c7d-9763-6d8a05e0998c taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.983777] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d82bad56-9830-4c7d-9763-6d8a05e0998c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.983855] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d82bad56-9830-4c7d-9763-6d8a05e0998c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.984074] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d82bad56-9830-4c7d-9763-6d8a05e0998c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.984237] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.984358] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.984428] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.984584] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.984689] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.984831] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d82bad56-9830-4c7d-9763-6d8a05e0998c',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1133.996162] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1b97992b-9002-4b6e-b809-d68f93354c99',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1134.079416] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 37349b8b-c2c1-4141-8b10-752c27492cbd: rpc.has_security_group_logging(os_id): False [ 1134.098463] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.098658] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.098658] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.098917] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.099024] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.099282] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.099391] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.099474] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.099631] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.099708] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.099797] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 37349b8b-c2c1-4141-8b10-752c27492cbd is going to be updated. [ 1134.171034] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.171171] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.171323] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.171661] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.172429] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.187325] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 37349b8b-c2c1-4141-8b10-752c27492cbd in Status: IN_PROGRESS for 2s [ 1134.487937] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.488141] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.488186] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.488458] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.488565] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.488771] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.488882] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.488946] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.489127] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.489265] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.489332] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d82bad56-9830-4c7d-9763-6d8a05e0998c is going to be updated. [ 1134.498347] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.498776] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.498776] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.498776] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.498999] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.498999] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1b97992b-9002-4b6e-b809-d68f93354c99 is going to be created. [ 1134.525268] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.525476] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.525476] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.525677] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.525801] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.531771] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.531944] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.531984] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.532211] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.532346] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.537950] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1b97992b-9002-4b6e-b809-d68f93354c99 in Status: UNINITIALIZED for 2s [ 1134.543543] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d82bad56-9830-4c7d-9763-6d8a05e0998c in Status: IN_PROGRESS for 2s [ 1134.673499] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 52d329d0-14c2-4610-ad32-9ade5237bab0 in Status: SUCCESS [ 1134.673794] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-52d329d0-14c2-4610-ad32-9ade5237bab0" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.673931] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-52d329d0-14c2-4610-ad32-9ade5237bab0" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.674179] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-52d329d0-14c2-4610-ad32-9ade5237bab0" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.674390] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.674508] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.674687] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.674723] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.674806] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.674894] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-52d329d0-14c2-4610-ad32-9ade5237bab0" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.674992] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('52d329d0-14c2-4610-ad32-9ade5237bab0',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1135.098302] env[65306]: INFO networking_nsxv3.common.synchronization [req-6c9d1234-88df-4c37-9d89-9bc6837c95aa req-8b5a87fe-dc7a-4eaf-a71c-f602a77878e6 tempest-ServerDiskConfigTestJSON-771154958 tempest-ServerDiskConfigTestJSON-771154958-project-member] Enqueued Resource ID: 9e80329d-1fcd-4c50-8991-a90e2a1fbdbc with Priority: HIGHEST for action security_group_members [ 1135.099084] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9e80329d-1fcd-4c50-8991-a90e2a1fbdbc with Priority: HIGHEST for action security_group_members [ 1135.099218] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-9e80329d-1fcd-4c50-8991-a90e2a1fbdbc taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.099269] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9e80329d-1fcd-4c50-8991-a90e2a1fbdbc" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.099466] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9e80329d-1fcd-4c50-8991-a90e2a1fbdbc" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.099547] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9e80329d-1fcd-4c50-8991-a90e2a1fbdbc" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.099657] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.099749] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.099807] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.099951] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.100218] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.100342] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9e80329d-1fcd-4c50-8991-a90e2a1fbdbc',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1135.177663] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('52d329d0-14c2-4610-ad32-9ade5237bab0',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1135.602557] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.603060] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.603060] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.603060] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.603178] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.603283] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.603385] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.603525] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.603601] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.603743] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.603842] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9e80329d-1fcd-4c50-8991-a90e2a1fbdbc is going to be updated. [ 1135.644385] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.644559] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.644627] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.644856] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.645016] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.658501] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9e80329d-1fcd-4c50-8991-a90e2a1fbdbc in Status: IN_PROGRESS for 2s [ 1135.681028] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 52d329d0-14c2-4610-ad32-9ade5237bab0: rpc.has_security_group_logging(os_id): False [ 1135.710644] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.710644] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.710644] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.711125] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.711125] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.711339] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.711480] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.711550] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.711877] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.711877] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.712027] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 52d329d0-14c2-4610-ad32-9ade5237bab0 is going to be created. [ 1135.815906] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.815906] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.815906] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.815906] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.815906] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.837562] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 52d329d0-14c2-4610-ad32-9ade5237bab0 in Status: IN_PROGRESS for 2s [ 1135.849427] env[65306]: INFO networking_nsxv3.common.synchronization [req-39acb35d-a644-4265-8e0d-3ce095536236 req-4613d465-d95f-4d47-95df-0145983bcf9f tempest-ServersTestJSON-1773114292 tempest-ServersTestJSON-1773114292-project-member] Enqueued Resource ID: 0cb41b0f-cdd2-4222-95b4-bafd614b7460 with Priority: HIGHEST for action security_group_members [ 1135.856817] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0cb41b0f-cdd2-4222-95b4-bafd614b7460 with Priority: HIGHEST for action security_group_members [ 1135.857284] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-0cb41b0f-cdd2-4222-95b4-bafd614b7460 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.857459] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0cb41b0f-cdd2-4222-95b4-bafd614b7460" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.857534] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0cb41b0f-cdd2-4222-95b4-bafd614b7460" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.857752] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0cb41b0f-cdd2-4222-95b4-bafd614b7460" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.857946] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.858072] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.858156] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.858472] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.858597] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.858682] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0cb41b0f-cdd2-4222-95b4-bafd614b7460',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1136.207975] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 37349b8b-c2c1-4141-8b10-752c27492cbd in Status: SUCCESS [ 1136.208316] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-37349b8b-c2c1-4141-8b10-752c27492cbd" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.273566] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock network-949 taken with stack trace [, , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.273916] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "network-949" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.274135] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "network-949" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.274429] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "network-949" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.274700] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.274866] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.275056] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.275289] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.275438] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.275650] env[65306]: DEBUG dogpile.cache.region [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] No value present for key: 'zone-id' {{(pid=65306) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1136.275788] env[65306]: DEBUG dogpile.lock [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] NeedRegenerationException {{(pid=65306) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1136.275923] env[65306]: DEBUG dogpile.lock [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] no value, waiting for create lock {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1136.276086] env[65306]: DEBUG dogpile.lock [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] value creation lock acquired {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1136.276291] env[65306]: DEBUG dogpile.cache.region [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] No value present for key: 'zone-id' {{(pid=65306) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1136.276461] env[65306]: DEBUG dogpile.lock [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Calling creation function for not-yet-present value {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1136.276669] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1136.297794] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1136.297972] env[65306]: DEBUG dogpile.cache.region [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65306) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1136.298114] env[65306]: DEBUG dogpile.lock [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Released creation lock {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1136.298293] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "network-949" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.298648] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock port-0c40fbbb-fed0-4203-9b75-d7706af113b6 taken with stack trace [, , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.298848] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "port-0c40fbbb-fed0-4203-9b75-d7706af113b6" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.298990] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "port-0c40fbbb-fed0-4203-9b75-d7706af113b6" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.299349] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "port-0c40fbbb-fed0-4203-9b75-d7706af113b6" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.299508] env[65306]: DEBUG networking_nsxv3.api.rpc [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0c40fbbb-fed0-4203-9b75-d7706af113b6',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1136.360721] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0cb41b0f-cdd2-4222-95b4-bafd614b7460',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1136.548941] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1b97992b-9002-4b6e-b809-d68f93354c99 in Status: SUCCESS [ 1136.549182] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1b97992b-9002-4b6e-b809-d68f93354c99" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.549341] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1b97992b-9002-4b6e-b809-d68f93354c99" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.549557] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1b97992b-9002-4b6e-b809-d68f93354c99" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.550032] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.550161] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.550232] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.550393] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.550476] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.550560] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1b97992b-9002-4b6e-b809-d68f93354c99" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.550653] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1b97992b-9002-4b6e-b809-d68f93354c99',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1136.552530] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d82bad56-9830-4c7d-9763-6d8a05e0998c in Status: SUCCESS [ 1136.553165] env[65306]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d82bad56-9830-4c7d-9763-6d8a05e0998c deletion is rescheduled due to dependency. [ 1136.553165] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d82bad56-9830-4c7d-9763-6d8a05e0998c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.802451] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.802901] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.803088] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.803443] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.803647] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.804047] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Segment Port 0c40fbbb-fed0-4203-9b75-d7706af113b6 not found, creating... [ 1136.804459] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.804692] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.804894] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.805275] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.805480] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.805966] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.806185] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.806356] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.806740] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.807087] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.807318] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Resource: SegmentPort with ID: 0c40fbbb-fed0-4203-9b75-d7706af113b6 is going to be created. [ 1136.829035] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.829286] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.829405] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.829688] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.829921] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.830164] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "port-0c40fbbb-fed0-4203-9b75-d7706af113b6" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.862922] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0cb41b0f-cdd2-4222-95b4-bafd614b7460',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1137.054233] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1b97992b-9002-4b6e-b809-d68f93354c99',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1137.365452] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.365661] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.365661] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.365920] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.366036] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.366143] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0cb41b0f-cdd2-4222-95b4-bafd614b7460 is going to be updated. [ 1137.402907] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.402907] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.402907] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.402907] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.402907] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.413699] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0cb41b0f-cdd2-4222-95b4-bafd614b7460 in Status: IN_PROGRESS for 2s [ 1137.557210] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1b97992b-9002-4b6e-b809-d68f93354c99: rpc.has_security_group_logging(os_id): False [ 1137.577041] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.577041] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.577041] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.577278] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.577278] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.577501] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.577605] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.577672] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.577823] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.577898] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.577988] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1b97992b-9002-4b6e-b809-d68f93354c99 is going to be created. [ 1137.590091] env[65306]: INFO networking_nsxv3.common.synchronization [req-39acb35d-a644-4265-8e0d-3ce095536236 req-67be0c54-6356-43a2-a5ad-da50044e8780 service nova] Enqueued Resource ID: 0cb41b0f-cdd2-4222-95b4-bafd614b7460 with Priority: HIGHEST for action security_group_rules [ 1137.590288] env[65306]: INFO networking_nsxv3.common.synchronization [req-39acb35d-a644-4265-8e0d-3ce095536236 req-67be0c54-6356-43a2-a5ad-da50044e8780 service nova] Enqueued Resource ID: 0cb41b0f-cdd2-4222-95b4-bafd614b7460 with Priority: HIGHEST for action security_group_members [ 1137.590440] env[65306]: INFO networking_nsxv3.common.synchronization [req-39acb35d-a644-4265-8e0d-3ce095536236 req-67be0c54-6356-43a2-a5ad-da50044e8780 service nova] Enqueued Resource ID: 0c40fbbb-fed0-4203-9b75-d7706af113b6 with Priority: HIGHEST for action port [ 1137.590981] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0cb41b0f-cdd2-4222-95b4-bafd614b7460 with Priority: HIGHEST for action security_group_rules [ 1137.591183] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0cb41b0f-cdd2-4222-95b4-bafd614b7460 with Priority: HIGHEST for action security_group_members [ 1137.591295] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0c40fbbb-fed0-4203-9b75-d7706af113b6 with Priority: HIGHEST for action port [ 1137.591706] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0cb41b0f-cdd2-4222-95b4-bafd614b7460 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.591794] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0cb41b0f-cdd2-4222-95b4-bafd614b7460" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.591851] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0cb41b0f-cdd2-4222-95b4-bafd614b7460" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.592069] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0cb41b0f-cdd2-4222-95b4-bafd614b7460" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.592154] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0cb41b0f-cdd2-4222-95b4-bafd614b7460',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1137.594033] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-0cb41b0f-cdd2-4222-95b4-bafd614b7460 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.594033] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0cb41b0f-cdd2-4222-95b4-bafd614b7460" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.594033] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock port-0c40fbbb-fed0-4203-9b75-d7706af113b6 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.594194] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0c40fbbb-fed0-4203-9b75-d7706af113b6" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.594194] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0c40fbbb-fed0-4203-9b75-d7706af113b6" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.594325] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0c40fbbb-fed0-4203-9b75-d7706af113b6" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.594358] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0c40fbbb-fed0-4203-9b75-d7706af113b6',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1137.640615] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.640800] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.640887] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.641041] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.641226] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.656318] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1b97992b-9002-4b6e-b809-d68f93354c99 in Status: IN_PROGRESS for 2s [ 1137.668088] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9e80329d-1fcd-4c50-8991-a90e2a1fbdbc in Status: SUCCESS [ 1137.668313] env[65306]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9e80329d-1fcd-4c50-8991-a90e2a1fbdbc deletion is rescheduled due to dependency. [ 1137.668429] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9e80329d-1fcd-4c50-8991-a90e2a1fbdbc" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.861050] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 52d329d0-14c2-4610-ad32-9ade5237bab0 in Status: SUCCESS [ 1137.861591] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-52d329d0-14c2-4610-ad32-9ade5237bab0" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.094804] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-0cb41b0f-cdd2-4222-95b4-bafd614b7460 taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.094970] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0cb41b0f-cdd2-4222-95b4-bafd614b7460" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.096354] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0c40fbbb-fed0-4203-9b75-d7706af113b6 with status ACTIVE [ 1138.096618] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.096804] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.096969] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.097325] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.097478] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.097722] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.097850] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.097959] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.098225] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.098373] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.098589] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.098718] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.098782] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.098968] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.099113] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.099237] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0c40fbbb-fed0-4203-9b75-d7706af113b6 is going to be updated. [ 1138.123464] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.123643] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.123750] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.124014] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.124200] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.124340] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0c40fbbb-fed0-4203-9b75-d7706af113b6" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.425450] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0cb41b0f-cdd2-4222-95b4-bafd614b7460 in Status: SUCCESS [ 1139.425663] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0cb41b0f-cdd2-4222-95b4-bafd614b7460" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.425834] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0cb41b0f-cdd2-4222-95b4-bafd614b7460" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.426160] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0cb41b0f-cdd2-4222-95b4-bafd614b7460" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.426382] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.426514] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.426583] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.426744] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.426829] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.426933] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0cb41b0f-cdd2-4222-95b4-bafd614b7460',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1139.672551] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1b97992b-9002-4b6e-b809-d68f93354c99 in Status: SUCCESS [ 1139.673306] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1b97992b-9002-4b6e-b809-d68f93354c99" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.930294] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0cb41b0f-cdd2-4222-95b4-bafd614b7460',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1140.433086] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0cb41b0f-cdd2-4222-95b4-bafd614b7460',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1140.940689] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.940993] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.941086] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.941303] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.941392] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.941490] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0cb41b0f-cdd2-4222-95b4-bafd614b7460 is going to be updated. [ 1140.970303] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.970562] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.970706] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.971045] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.971296] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.986616] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0cb41b0f-cdd2-4222-95b4-bafd614b7460 in Status: IN_PROGRESS for 2s [ 1141.831414] env[65306]: INFO networking_nsxv3.common.synchronization [req-63dd9dcc-a8bc-42cd-b04f-873a07dc307d req-4c336a98-c84d-471a-b622-9c024332df57 tempest-DeleteServersTestJSON-1340326246 tempest-DeleteServersTestJSON-1340326246-project-member] Enqueued Resource ID: d82bad56-9830-4c7d-9763-6d8a05e0998c with Priority: HIGHEST for action security_group_members [ 1141.832072] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d82bad56-9830-4c7d-9763-6d8a05e0998c with Priority: HIGHEST for action security_group_members [ 1141.832395] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-d82bad56-9830-4c7d-9763-6d8a05e0998c taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.832520] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d82bad56-9830-4c7d-9763-6d8a05e0998c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.832585] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d82bad56-9830-4c7d-9763-6d8a05e0998c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.832787] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d82bad56-9830-4c7d-9763-6d8a05e0998c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.832941] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.833051] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.833112] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.834510] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.834510] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.834510] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d82bad56-9830-4c7d-9763-6d8a05e0998c',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1142.336034] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.336281] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.336359] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.336570] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.337344] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.337344] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.337344] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.337344] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.337344] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.337344] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.337344] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d82bad56-9830-4c7d-9763-6d8a05e0998c is going to be updated. [ 1142.373533] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.373533] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.373533] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.373533] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.373872] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.386735] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d82bad56-9830-4c7d-9763-6d8a05e0998c in Status: IN_PROGRESS for 2s [ 1142.397114] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock network-591 taken with stack trace [, , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.397347] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "network-591" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.397510] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "network-591" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.397697] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "network-591" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.397988] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.398645] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.398818] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.399321] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.399321] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.399583] env[65306]: DEBUG dogpile.cache.region [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] No value present for key: 'zone-id' {{(pid=65306) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1142.399736] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] NeedRegenerationException {{(pid=65306) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1142.399876] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] no value, waiting for create lock {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1142.400017] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] value creation lock acquired {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1142.400167] env[65306]: DEBUG dogpile.cache.region [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] No value present for key: 'zone-id' {{(pid=65306) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1142.400302] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Calling creation function for not-yet-present value {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1142.400466] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1142.424575] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1142.424918] env[65306]: DEBUG dogpile.cache.region [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65306) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1142.425039] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Released creation lock {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1142.425226] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "network-591" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.425558] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock port-5724c70e-0398-481c-875a-369c21d9b93d taken with stack trace [, , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.425826] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "port-5724c70e-0398-481c-875a-369c21d9b93d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.425966] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "port-5724c70e-0398-481c-875a-369c21d9b93d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.426351] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "port-5724c70e-0398-481c-875a-369c21d9b93d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.426493] env[65306]: DEBUG networking_nsxv3.api.rpc [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5724c70e-0398-481c-875a-369c21d9b93d',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1142.929622] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.930160] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.930334] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.930620] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.930784] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.930973] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Segment Port 5724c70e-0398-481c-875a-369c21d9b93d not found, creating... [ 1142.931342] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.931592] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.931732] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.932016] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.932355] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.932864] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.933152] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.933390] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.933784] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.934067] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.934291] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Resource: SegmentPort with ID: 5724c70e-0398-481c-875a-369c21d9b93d is going to be created. [ 1142.959358] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.959739] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.959739] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.960421] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.960421] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.960673] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "port-5724c70e-0398-481c-875a-369c21d9b93d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.999712] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0cb41b0f-cdd2-4222-95b4-bafd614b7460 in Status: SUCCESS [ 1142.999712] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0cb41b0f-cdd2-4222-95b4-bafd614b7460" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.999712] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0cb41b0f-cdd2-4222-95b4-bafd614b7460" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.000482] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0cb41b0f-cdd2-4222-95b4-bafd614b7460" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.000482] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.000482] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.000482] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.000843] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.001029] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.001188] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0cb41b0f-cdd2-4222-95b4-bafd614b7460" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.001368] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0cb41b0f-cdd2-4222-95b4-bafd614b7460',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1143.504233] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-0cb41b0f-cdd2-4222-95b4-bafd614b7460 taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.504596] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0cb41b0f-cdd2-4222-95b4-bafd614b7460" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.504596] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0cb41b0f-cdd2-4222-95b4-bafd614b7460" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.504687] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0cb41b0f-cdd2-4222-95b4-bafd614b7460" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.505135] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.505135] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.505135] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.505313] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.506145] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.506145] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0cb41b0f-cdd2-4222-95b4-bafd614b7460" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.506145] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-0cb41b0f-cdd2-4222-95b4-bafd614b7460 taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.506145] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0cb41b0f-cdd2-4222-95b4-bafd614b7460" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.506145] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0cb41b0f-cdd2-4222-95b4-bafd614b7460" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.506145] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0cb41b0f-cdd2-4222-95b4-bafd614b7460" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.506402] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.506402] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.507149] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.507149] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.507149] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.508114] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0cb41b0f-cdd2-4222-95b4-bafd614b7460" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.508114] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0cb41b0f-cdd2-4222-95b4-bafd614b7460',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1143.778192] env[65306]: INFO networking_nsxv3.common.synchronization [req-63dd9dcc-a8bc-42cd-b04f-873a07dc307d req-bda66f08-8483-4f23-9102-e48fd7d3c2a9 service nova] Enqueued Resource ID: d82bad56-9830-4c7d-9763-6d8a05e0998c with Priority: HIGHEST for action security_group_rules [ 1143.778656] env[65306]: INFO networking_nsxv3.common.synchronization [req-63dd9dcc-a8bc-42cd-b04f-873a07dc307d req-bda66f08-8483-4f23-9102-e48fd7d3c2a9 service nova] Enqueued Resource ID: d82bad56-9830-4c7d-9763-6d8a05e0998c with Priority: HIGHEST for action security_group_members [ 1143.778656] env[65306]: INFO networking_nsxv3.common.synchronization [req-63dd9dcc-a8bc-42cd-b04f-873a07dc307d req-bda66f08-8483-4f23-9102-e48fd7d3c2a9 service nova] Enqueued Resource ID: 5724c70e-0398-481c-875a-369c21d9b93d with Priority: HIGHEST for action port [ 1143.779136] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d82bad56-9830-4c7d-9763-6d8a05e0998c with Priority: HIGHEST for action security_group_rules [ 1143.779345] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d82bad56-9830-4c7d-9763-6d8a05e0998c with Priority: HIGHEST for action security_group_members [ 1143.779485] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5724c70e-0398-481c-875a-369c21d9b93d with Priority: HIGHEST for action port [ 1143.780794] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d82bad56-9830-4c7d-9763-6d8a05e0998c taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.781110] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d82bad56-9830-4c7d-9763-6d8a05e0998c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.781230] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d82bad56-9830-4c7d-9763-6d8a05e0998c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.781500] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d82bad56-9830-4c7d-9763-6d8a05e0998c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.781701] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d82bad56-9830-4c7d-9763-6d8a05e0998c',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1143.785757] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-d82bad56-9830-4c7d-9763-6d8a05e0998c taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.785757] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d82bad56-9830-4c7d-9763-6d8a05e0998c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.788207] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock port-5724c70e-0398-481c-875a-369c21d9b93d taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.789254] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5724c70e-0398-481c-875a-369c21d9b93d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.789333] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5724c70e-0398-481c-875a-369c21d9b93d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.789961] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5724c70e-0398-481c-875a-369c21d9b93d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.789961] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5724c70e-0398-481c-875a-369c21d9b93d',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1144.010828] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0cb41b0f-cdd2-4222-95b4-bafd614b7460: rpc.has_security_group_logging(os_id): False [ 1144.031925] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.032136] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.032223] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.032416] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.032799] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.032799] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.032799] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.033104] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.033104] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.033104] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.033318] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.033403] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.033521] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.033699] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.033848] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.034183] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.034303] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.034393] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.034508] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.034583] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.034698] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0cb41b0f-cdd2-4222-95b4-bafd614b7460 is going to be updated. [ 1144.111303] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.111590] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.111590] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.111852] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.111902] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.129033] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0cb41b0f-cdd2-4222-95b4-bafd614b7460 in Status: IN_PROGRESS for 2s [ 1144.291743] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-d82bad56-9830-4c7d-9763-6d8a05e0998c taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.291924] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d82bad56-9830-4c7d-9763-6d8a05e0998c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.292156] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5724c70e-0398-481c-875a-369c21d9b93d with status ACTIVE [ 1144.292387] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.292580] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.292657] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.292971] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.293138] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.293295] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.293430] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.293519] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.294105] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.294105] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.294258] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.294366] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.294485] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.294642] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.294998] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.294998] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5724c70e-0398-481c-875a-369c21d9b93d is going to be updated. [ 1144.322020] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.322306] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.322525] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.322797] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.323101] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.323368] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5724c70e-0398-481c-875a-369c21d9b93d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.400021] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d82bad56-9830-4c7d-9763-6d8a05e0998c in Status: SUCCESS [ 1144.400190] env[65306]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d82bad56-9830-4c7d-9763-6d8a05e0998c deletion is rescheduled due to dependency. [ 1144.400275] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d82bad56-9830-4c7d-9763-6d8a05e0998c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.400452] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d82bad56-9830-4c7d-9763-6d8a05e0998c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.400716] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d82bad56-9830-4c7d-9763-6d8a05e0998c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.400962] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.401116] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.401116] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.401282] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.401341] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.401471] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d82bad56-9830-4c7d-9763-6d8a05e0998c',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1144.905294] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d82bad56-9830-4c7d-9763-6d8a05e0998c',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1145.192459] env[65306]: INFO networking_nsxv3.common.synchronization [None req-81ca041d-573b-47ac-b01e-7355eca47f39 tempest-ServerRescueNegativeTestJSON-1491097463 tempest-ServerRescueNegativeTestJSON-1491097463-project-member] Enqueued Resource ID: 9672ecd6-e064-4287-b1ae-4b673c86ae96 with Priority: HIGHEST for action security_group_rules [ 1145.193032] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9672ecd6-e064-4287-b1ae-4b673c86ae96 with Priority: HIGHEST for action security_group_rules [ 1145.193241] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9672ecd6-e064-4287-b1ae-4b673c86ae96 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.193354] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9672ecd6-e064-4287-b1ae-4b673c86ae96" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.193412] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9672ecd6-e064-4287-b1ae-4b673c86ae96" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.193685] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9672ecd6-e064-4287-b1ae-4b673c86ae96" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.193801] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9672ecd6-e064-4287-b1ae-4b673c86ae96',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1145.407260] env[65306]: INFO networking_nsxv3.common.synchronization [None req-5f79ecc4-5755-4373-af14-06f9c7de8271 tempest-ServerRescueNegativeTestJSON-1491097463 tempest-ServerRescueNegativeTestJSON-1491097463-project-member] Enqueued Resource ID: 9672ecd6-e064-4287-b1ae-4b673c86ae96 with Priority: HIGHEST for action security_group_rules [ 1145.407895] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d82bad56-9830-4c7d-9763-6d8a05e0998c',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1145.409115] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9672ecd6-e064-4287-b1ae-4b673c86ae96 with Priority: HIGHEST for action security_group_rules [ 1145.409837] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9672ecd6-e064-4287-b1ae-4b673c86ae96 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.409948] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9672ecd6-e064-4287-b1ae-4b673c86ae96" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.717494] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.717494] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.717494] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.717494] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.717494] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.717494] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9672ecd6-e064-4287-b1ae-4b673c86ae96 already deleted. [ 1145.717494] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9672ecd6-e064-4287-b1ae-4b673c86ae96" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.717494] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9672ecd6-e064-4287-b1ae-4b673c86ae96" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.717494] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9672ecd6-e064-4287-b1ae-4b673c86ae96" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.717494] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9672ecd6-e064-4287-b1ae-4b673c86ae96',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1145.911010] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.911333] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.911333] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.911530] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.911640] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.911792] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d82bad56-9830-4c7d-9763-6d8a05e0998c is going to be updated. [ 1145.949727] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.949900] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.949960] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.950328] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.950460] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.962812] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d82bad56-9830-4c7d-9763-6d8a05e0998c in Status: IN_PROGRESS for 2s [ 1146.146632] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0cb41b0f-cdd2-4222-95b4-bafd614b7460 in Status: SUCCESS [ 1146.146707] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0cb41b0f-cdd2-4222-95b4-bafd614b7460" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.240868] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.241267] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.241267] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.241438] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.241505] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.241568] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9672ecd6-e064-4287-b1ae-4b673c86ae96 already deleted. [ 1146.241651] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9672ecd6-e064-4287-b1ae-4b673c86ae96" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.410599] env[65306]: INFO networking_nsxv3.common.synchronization [None req-387fab02-e347-4faf-b7fb-ebf930d05f27 None None] Enqueued Resource ID: 716741a2-695e-45d1-b356-d23bed2b74d7 with Priority: HIGHEST for action port [ 1146.411096] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 716741a2-695e-45d1-b356-d23bed2b74d7 with Priority: HIGHEST for action port [ 1146.411278] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock port-716741a2-695e-45d1-b356-d23bed2b74d7 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.412742] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-716741a2-695e-45d1-b356-d23bed2b74d7" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.412742] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-716741a2-695e-45d1-b356-d23bed2b74d7" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.412742] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-716741a2-695e-45d1-b356-d23bed2b74d7" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.412742] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('716741a2-695e-45d1-b356-d23bed2b74d7',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1146.914719] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 716741a2-695e-45d1-b356-d23bed2b74d7 [ 1146.916046] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.916046] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.916046] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.916046] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.916046] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.916046] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:716741a2-695e-45d1-b356-d23bed2b74d7 already deleted. [ 1146.916046] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-716741a2-695e-45d1-b356-d23bed2b74d7" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.381966] env[65306]: INFO networking_nsxv3.common.synchronization [None req-8ad9c5b4-e159-4416-8042-baab9828c982 tempest-ServerActionsTestOtherA-65612913 tempest-ServerActionsTestOtherA-65612913-project-member] Enqueued Resource ID: 3bf31731-6b75-4dfa-b76c-ee83bdf17eaa with Priority: HIGHEST for action security_group_rules [ 1147.383203] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3bf31731-6b75-4dfa-b76c-ee83bdf17eaa with Priority: HIGHEST for action security_group_rules [ 1147.383203] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3bf31731-6b75-4dfa-b76c-ee83bdf17eaa taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.383355] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3bf31731-6b75-4dfa-b76c-ee83bdf17eaa" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.383456] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3bf31731-6b75-4dfa-b76c-ee83bdf17eaa" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.384579] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3bf31731-6b75-4dfa-b76c-ee83bdf17eaa" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.384579] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3bf31731-6b75-4dfa-b76c-ee83bdf17eaa',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1147.479443] env[65306]: INFO networking_nsxv3.common.synchronization [None req-42155afa-85a8-458d-93b4-c2b0c0393583 tempest-ServerActionsTestOtherA-65612913 tempest-ServerActionsTestOtherA-65612913-project-member] Enqueued Resource ID: 3bf31731-6b75-4dfa-b76c-ee83bdf17eaa with Priority: HIGHEST for action security_group_rules [ 1147.480113] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3bf31731-6b75-4dfa-b76c-ee83bdf17eaa with Priority: HIGHEST for action security_group_rules [ 1147.480441] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3bf31731-6b75-4dfa-b76c-ee83bdf17eaa taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.480545] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3bf31731-6b75-4dfa-b76c-ee83bdf17eaa" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.911161] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.911402] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.911487] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.912030] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.912030] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.912030] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3bf31731-6b75-4dfa-b76c-ee83bdf17eaa already deleted. [ 1147.912030] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3bf31731-6b75-4dfa-b76c-ee83bdf17eaa" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.912206] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3bf31731-6b75-4dfa-b76c-ee83bdf17eaa" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.912339] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3bf31731-6b75-4dfa-b76c-ee83bdf17eaa" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.912418] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3bf31731-6b75-4dfa-b76c-ee83bdf17eaa',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1147.977176] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d82bad56-9830-4c7d-9763-6d8a05e0998c in Status: SUCCESS [ 1147.977176] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d82bad56-9830-4c7d-9763-6d8a05e0998c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.977176] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d82bad56-9830-4c7d-9763-6d8a05e0998c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.977176] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d82bad56-9830-4c7d-9763-6d8a05e0998c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.977176] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.977176] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.977176] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.977176] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.977176] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.977176] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d82bad56-9830-4c7d-9763-6d8a05e0998c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.977176] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d82bad56-9830-4c7d-9763-6d8a05e0998c',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1148.440242] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.440242] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.440242] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.440242] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.440242] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.440242] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3bf31731-6b75-4dfa-b76c-ee83bdf17eaa already deleted. [ 1148.440242] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3bf31731-6b75-4dfa-b76c-ee83bdf17eaa" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.480732] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-d82bad56-9830-4c7d-9763-6d8a05e0998c taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.480963] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d82bad56-9830-4c7d-9763-6d8a05e0998c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.480963] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d82bad56-9830-4c7d-9763-6d8a05e0998c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.481175] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d82bad56-9830-4c7d-9763-6d8a05e0998c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.481303] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.481407] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.481478] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.481742] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.481817] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.481855] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d82bad56-9830-4c7d-9763-6d8a05e0998c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.481999] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-d82bad56-9830-4c7d-9763-6d8a05e0998c taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.482107] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d82bad56-9830-4c7d-9763-6d8a05e0998c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.482169] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d82bad56-9830-4c7d-9763-6d8a05e0998c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.482319] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d82bad56-9830-4c7d-9763-6d8a05e0998c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.482532] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.482653] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.482715] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.483020] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.483020] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.483020] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d82bad56-9830-4c7d-9763-6d8a05e0998c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.483143] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d82bad56-9830-4c7d-9763-6d8a05e0998c',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1148.986070] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d82bad56-9830-4c7d-9763-6d8a05e0998c: rpc.has_security_group_logging(os_id): False [ 1149.006011] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.006236] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.006379] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.006594] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.006740] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.006999] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.007151] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.007248] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.007529] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.007649] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.007898] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.008043] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.008141] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.008334] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.008435] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.008695] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.008794] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.008869] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.009078] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.009207] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.009333] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d82bad56-9830-4c7d-9763-6d8a05e0998c is going to be updated. [ 1149.082350] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.082543] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.082697] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.082998] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.083227] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.102619] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d82bad56-9830-4c7d-9763-6d8a05e0998c in Status: IN_PROGRESS for 2s [ 1149.627672] env[65306]: INFO networking_nsxv3.common.synchronization [req-4bcee702-167b-4dfc-9b97-a73dfb976598 req-78d423d7-a0e4-42e0-976f-befbcfdf175c tempest-ServersTestJSON-1773114292 tempest-ServersTestJSON-1773114292-project-member] Enqueued Resource ID: 0cb41b0f-cdd2-4222-95b4-bafd614b7460 with Priority: HIGHEST for action security_group_members [ 1149.627672] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0cb41b0f-cdd2-4222-95b4-bafd614b7460 with Priority: HIGHEST for action security_group_members [ 1149.628106] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-0cb41b0f-cdd2-4222-95b4-bafd614b7460 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.629216] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0cb41b0f-cdd2-4222-95b4-bafd614b7460" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.629216] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0cb41b0f-cdd2-4222-95b4-bafd614b7460" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.629216] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0cb41b0f-cdd2-4222-95b4-bafd614b7460" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.629216] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.629216] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.629216] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.629216] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.629216] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.629492] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0cb41b0f-cdd2-4222-95b4-bafd614b7460',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1150.011779] env[65306]: INFO networking_nsxv3.common.synchronization [None req-5fda7f46-2701-4b1f-961a-f607d08cccfa None None] Enqueued Resource ID: 183e44ec-5fa0-48ab-8714-b2f54a8a64e0 with Priority: HIGHEST for action port [ 1150.012423] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 183e44ec-5fa0-48ab-8714-b2f54a8a64e0 with Priority: HIGHEST for action port [ 1150.012739] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock port-183e44ec-5fa0-48ab-8714-b2f54a8a64e0 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.012863] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-183e44ec-5fa0-48ab-8714-b2f54a8a64e0" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.012934] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-183e44ec-5fa0-48ab-8714-b2f54a8a64e0" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.013216] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-183e44ec-5fa0-48ab-8714-b2f54a8a64e0" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.013303] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('183e44ec-5fa0-48ab-8714-b2f54a8a64e0',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1150.132158] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0cb41b0f-cdd2-4222-95b4-bafd614b7460',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1150.515079] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 183e44ec-5fa0-48ab-8714-b2f54a8a64e0 [ 1150.515336] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.515472] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.515541] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.515754] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.515845] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.515975] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:183e44ec-5fa0-48ab-8714-b2f54a8a64e0 already deleted. [ 1150.516081] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-183e44ec-5fa0-48ab-8714-b2f54a8a64e0" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.634301] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0cb41b0f-cdd2-4222-95b4-bafd614b7460',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1151.121122] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d82bad56-9830-4c7d-9763-6d8a05e0998c in Status: SUCCESS [ 1151.121285] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d82bad56-9830-4c7d-9763-6d8a05e0998c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.138020] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.138219] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.138275] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.138501] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.138610] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.138718] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0cb41b0f-cdd2-4222-95b4-bafd614b7460 is going to be updated. [ 1151.168075] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.168229] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.168321] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.168608] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.168758] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.182358] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0cb41b0f-cdd2-4222-95b4-bafd614b7460 in Status: IN_PROGRESS for 2s [ 1151.595518] env[65306]: INFO networking_nsxv3.common.synchronization [req-32e47403-7509-4dce-bdf7-1dee166b5716 req-02e7d583-88e2-41f7-82c5-90d9cebe2105 tempest-ServerRescueNegativeTestJSON-1491097463 tempest-ServerRescueNegativeTestJSON-1491097463-project-member] Enqueued Resource ID: 9672ecd6-e064-4287-b1ae-4b673c86ae96 with Priority: HIGHEST for action security_group_members [ 1151.596061] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9672ecd6-e064-4287-b1ae-4b673c86ae96 with Priority: HIGHEST for action security_group_members [ 1151.596392] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-9672ecd6-e064-4287-b1ae-4b673c86ae96 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.596476] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9672ecd6-e064-4287-b1ae-4b673c86ae96" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.596543] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9672ecd6-e064-4287-b1ae-4b673c86ae96" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.596826] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9672ecd6-e064-4287-b1ae-4b673c86ae96" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.596998] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.597128] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.597196] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.597350] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.597435] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.597526] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9672ecd6-e064-4287-b1ae-4b673c86ae96',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1151.907389] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock network-845 taken with stack trace [, , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.907389] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "network-845" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.907389] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "network-845" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.907835] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "network-845" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.908030] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.908270] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.908443] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.908783] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.908989] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.909242] env[65306]: DEBUG dogpile.cache.region [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] No value present for key: 'zone-id' {{(pid=65306) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1151.909363] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] NeedRegenerationException {{(pid=65306) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1151.909474] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] no value, waiting for create lock {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1151.909584] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] value creation lock acquired {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1151.909693] env[65306]: DEBUG dogpile.cache.region [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] No value present for key: 'zone-id' {{(pid=65306) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1151.909796] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Calling creation function for not-yet-present value {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1151.909929] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1151.931600] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1151.931600] env[65306]: DEBUG dogpile.cache.region [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65306) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1151.931600] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Released creation lock {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1151.931871] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "network-845" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.932117] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock port-28529812-1676-41d9-8811-683e33c22a87 taken with stack trace [, , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.932313] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "port-28529812-1676-41d9-8811-683e33c22a87" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.932433] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "port-28529812-1676-41d9-8811-683e33c22a87" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.932781] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "port-28529812-1676-41d9-8811-683e33c22a87" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.932927] env[65306]: DEBUG networking_nsxv3.api.rpc [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('28529812-1676-41d9-8811-683e33c22a87',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1152.100917] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.101158] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.101231] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.101455] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.101548] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.101757] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.101856] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.101949] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.102123] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.102201] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.102294] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9672ecd6-e064-4287-b1ae-4b673c86ae96 already deleted. [ 1152.102365] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9672ecd6-e064-4287-b1ae-4b673c86ae96" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.436025] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.436223] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.436390] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.436675] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.436834] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.437420] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Segment Port 28529812-1676-41d9-8811-683e33c22a87 not found, creating... [ 1152.437723] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.437888] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.438025] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.438264] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.438676] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.438676] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.438826] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.438949] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.439357] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.439501] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.439646] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Resource: SegmentPort with ID: 28529812-1676-41d9-8811-683e33c22a87 is going to be created. [ 1152.460376] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.460590] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.460713] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.460983] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.461272] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.461502] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "port-28529812-1676-41d9-8811-683e33c22a87" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.192737] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0cb41b0f-cdd2-4222-95b4-bafd614b7460 in Status: SUCCESS [ 1153.192737] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0cb41b0f-cdd2-4222-95b4-bafd614b7460" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.202205] env[65306]: INFO networking_nsxv3.common.synchronization [req-32e47403-7509-4dce-bdf7-1dee166b5716 req-4a5cc7fb-25ff-4292-ace0-ad1ccab27259 service nova] Enqueued Resource ID: 9672ecd6-e064-4287-b1ae-4b673c86ae96 with Priority: HIGHEST for action security_group_rules [ 1153.202205] env[65306]: INFO networking_nsxv3.common.synchronization [req-32e47403-7509-4dce-bdf7-1dee166b5716 req-4a5cc7fb-25ff-4292-ace0-ad1ccab27259 service nova] Enqueued Resource ID: 9672ecd6-e064-4287-b1ae-4b673c86ae96 with Priority: HIGHEST for action security_group_members [ 1153.202205] env[65306]: INFO networking_nsxv3.common.synchronization [req-32e47403-7509-4dce-bdf7-1dee166b5716 req-4a5cc7fb-25ff-4292-ace0-ad1ccab27259 service nova] Enqueued Resource ID: 28529812-1676-41d9-8811-683e33c22a87 with Priority: HIGHEST for action port [ 1153.202205] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9672ecd6-e064-4287-b1ae-4b673c86ae96 with Priority: HIGHEST for action security_group_rules [ 1153.202205] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9672ecd6-e064-4287-b1ae-4b673c86ae96 with Priority: HIGHEST for action security_group_members [ 1153.202205] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 28529812-1676-41d9-8811-683e33c22a87 with Priority: HIGHEST for action port [ 1153.203022] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9672ecd6-e064-4287-b1ae-4b673c86ae96 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.203364] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9672ecd6-e064-4287-b1ae-4b673c86ae96" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.203573] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9672ecd6-e064-4287-b1ae-4b673c86ae96" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.203931] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9672ecd6-e064-4287-b1ae-4b673c86ae96" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.204139] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9672ecd6-e064-4287-b1ae-4b673c86ae96',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1153.210366] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-9672ecd6-e064-4287-b1ae-4b673c86ae96 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.210366] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9672ecd6-e064-4287-b1ae-4b673c86ae96" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.210366] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9672ecd6-e064-4287-b1ae-4b673c86ae96" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.210366] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9672ecd6-e064-4287-b1ae-4b673c86ae96" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.210366] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.210366] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.210366] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.210366] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.210366] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.210366] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9672ecd6-e064-4287-b1ae-4b673c86ae96',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1153.212809] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock port-28529812-1676-41d9-8811-683e33c22a87 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.212978] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-28529812-1676-41d9-8811-683e33c22a87" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.213034] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-28529812-1676-41d9-8811-683e33c22a87" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.213265] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-28529812-1676-41d9-8811-683e33c22a87" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.213317] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('28529812-1676-41d9-8811-683e33c22a87',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1153.715368] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-9672ecd6-e064-4287-b1ae-4b673c86ae96 taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.715493] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9672ecd6-e064-4287-b1ae-4b673c86ae96" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.715691] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9672ecd6-e064-4287-b1ae-4b673c86ae96',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1153.717055] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 28529812-1676-41d9-8811-683e33c22a87 with status ACTIVE [ 1153.717279] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.717417] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.717486] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.717735] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.717826] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.718157] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.718236] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.718308] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.718477] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.718536] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.718760] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.718863] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.718916] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.719106] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.719440] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.719593] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 28529812-1676-41d9-8811-683e33c22a87 is going to be updated. [ 1153.740310] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.740499] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.740549] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.740721] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.740856] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.741042] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-28529812-1676-41d9-8811-683e33c22a87" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.895122] env[65306]: INFO networking_nsxv3.common.synchronization [req-5e828d05-b17b-4b03-a262-97fc67d11f02 req-feafcb40-1a6a-4212-9375-3ae36f9eb21b tempest-ServerActionsTestOtherA-65612913 tempest-ServerActionsTestOtherA-65612913-project-member] Enqueued Resource ID: 3bf31731-6b75-4dfa-b76c-ee83bdf17eaa with Priority: HIGHEST for action security_group_members [ 1153.895717] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3bf31731-6b75-4dfa-b76c-ee83bdf17eaa with Priority: HIGHEST for action security_group_members [ 1153.896036] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-3bf31731-6b75-4dfa-b76c-ee83bdf17eaa taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.896161] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3bf31731-6b75-4dfa-b76c-ee83bdf17eaa" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.896243] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3bf31731-6b75-4dfa-b76c-ee83bdf17eaa" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.896512] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3bf31731-6b75-4dfa-b76c-ee83bdf17eaa" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.896684] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.896785] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.896848] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.897013] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.897110] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.897205] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3bf31731-6b75-4dfa-b76c-ee83bdf17eaa',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1154.179166] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock network-435 taken with stack trace [, , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.179371] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "network-435" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.179501] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "network-435" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.179823] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "network-435" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.180108] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.180268] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.180384] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.180597] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.180741] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.180945] env[65306]: DEBUG dogpile.cache.region [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] No value present for key: 'zone-id' {{(pid=65306) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1154.181074] env[65306]: DEBUG dogpile.lock [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] NeedRegenerationException {{(pid=65306) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1154.181178] env[65306]: DEBUG dogpile.lock [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] no value, waiting for create lock {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1154.181287] env[65306]: DEBUG dogpile.lock [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] value creation lock acquired {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1154.181394] env[65306]: DEBUG dogpile.cache.region [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] No value present for key: 'zone-id' {{(pid=65306) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1154.181498] env[65306]: DEBUG dogpile.lock [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Calling creation function for not-yet-present value {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1154.181628] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1154.201721] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1154.202459] env[65306]: DEBUG dogpile.cache.region [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65306) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1154.202459] env[65306]: DEBUG dogpile.lock [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Released creation lock {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1154.202459] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "network-435" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.202672] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock port-d8c669d0-af00-4283-a012-c555fc62a056 taken with stack trace [, , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.202747] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "port-d8c669d0-af00-4283-a012-c555fc62a056" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.202851] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "port-d8c669d0-af00-4283-a012-c555fc62a056" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.203198] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "port-d8c669d0-af00-4283-a012-c555fc62a056" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.203341] env[65306]: DEBUG networking_nsxv3.api.rpc [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d8c669d0-af00-4283-a012-c555fc62a056',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1154.217343] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9672ecd6-e064-4287-b1ae-4b673c86ae96',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1154.399873] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.399873] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.399873] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.399873] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.399873] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.400185] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.400185] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.400185] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.400342] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.400342] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.400404] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3bf31731-6b75-4dfa-b76c-ee83bdf17eaa already deleted. [ 1154.400481] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3bf31731-6b75-4dfa-b76c-ee83bdf17eaa" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.706018] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.706283] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.706436] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.706720] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.706874] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.707039] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Segment Port d8c669d0-af00-4283-a012-c555fc62a056 not found, creating... [ 1154.707305] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.707462] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.707577] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.707792] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.707927] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.708231] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.708384] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.708496] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.708701] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.708834] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.708974] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Resource: SegmentPort with ID: d8c669d0-af00-4283-a012-c555fc62a056 is going to be created. [ 1154.721741] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.721880] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.721955] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.722166] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.722255] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.722341] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9672ecd6-e064-4287-b1ae-4b673c86ae96 is going to be created. [ 1154.734365] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.734580] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.734711] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.735038] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.735276] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.735745] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "port-d8c669d0-af00-4283-a012-c555fc62a056" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.756521] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.756798] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.756798] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.757092] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.757318] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.767374] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9672ecd6-e064-4287-b1ae-4b673c86ae96 in Status: UNINITIALIZED for 2s [ 1155.486117] env[65306]: INFO networking_nsxv3.common.synchronization [req-5e828d05-b17b-4b03-a262-97fc67d11f02 req-3267391a-d0e6-4c47-ad5c-53d30f31d79e service nova] Enqueued Resource ID: 3bf31731-6b75-4dfa-b76c-ee83bdf17eaa with Priority: HIGHEST for action security_group_rules [ 1155.486393] env[65306]: INFO networking_nsxv3.common.synchronization [req-5e828d05-b17b-4b03-a262-97fc67d11f02 req-3267391a-d0e6-4c47-ad5c-53d30f31d79e service nova] Enqueued Resource ID: 3bf31731-6b75-4dfa-b76c-ee83bdf17eaa with Priority: HIGHEST for action security_group_members [ 1155.486527] env[65306]: INFO networking_nsxv3.common.synchronization [req-5e828d05-b17b-4b03-a262-97fc67d11f02 req-3267391a-d0e6-4c47-ad5c-53d30f31d79e service nova] Enqueued Resource ID: d8c669d0-af00-4283-a012-c555fc62a056 with Priority: HIGHEST for action port [ 1155.487162] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3bf31731-6b75-4dfa-b76c-ee83bdf17eaa with Priority: HIGHEST for action security_group_rules [ 1155.487368] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3bf31731-6b75-4dfa-b76c-ee83bdf17eaa with Priority: HIGHEST for action security_group_members [ 1155.487512] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d8c669d0-af00-4283-a012-c555fc62a056 with Priority: HIGHEST for action port [ 1155.487871] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3bf31731-6b75-4dfa-b76c-ee83bdf17eaa taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.488023] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3bf31731-6b75-4dfa-b76c-ee83bdf17eaa" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.488133] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3bf31731-6b75-4dfa-b76c-ee83bdf17eaa" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.488373] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3bf31731-6b75-4dfa-b76c-ee83bdf17eaa" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.488499] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3bf31731-6b75-4dfa-b76c-ee83bdf17eaa',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1155.489602] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-3bf31731-6b75-4dfa-b76c-ee83bdf17eaa taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.489602] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3bf31731-6b75-4dfa-b76c-ee83bdf17eaa" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.489725] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3bf31731-6b75-4dfa-b76c-ee83bdf17eaa" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.489916] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3bf31731-6b75-4dfa-b76c-ee83bdf17eaa" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.490329] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.490329] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.490329] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.491364] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.491364] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.491364] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3bf31731-6b75-4dfa-b76c-ee83bdf17eaa',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1155.491703] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock port-d8c669d0-af00-4283-a012-c555fc62a056 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.491703] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d8c669d0-af00-4283-a012-c555fc62a056" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.491703] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d8c669d0-af00-4283-a012-c555fc62a056" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.491939] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d8c669d0-af00-4283-a012-c555fc62a056" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.492105] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d8c669d0-af00-4283-a012-c555fc62a056',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1155.994421] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-3bf31731-6b75-4dfa-b76c-ee83bdf17eaa taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.994421] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3bf31731-6b75-4dfa-b76c-ee83bdf17eaa" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.994421] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3bf31731-6b75-4dfa-b76c-ee83bdf17eaa',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1155.995123] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d8c669d0-af00-4283-a012-c555fc62a056 with status ACTIVE [ 1155.995307] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.995416] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.995481] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.995679] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.995762] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.995936] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.996064] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.996130] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.996307] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.996307] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.996495] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.996595] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.996657] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.996796] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.996866] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.996924] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d8c669d0-af00-4283-a012-c555fc62a056 is going to be updated. [ 1156.021473] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.021723] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.021723] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.022026] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.022233] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.022473] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d8c669d0-af00-4283-a012-c555fc62a056" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.499171] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3bf31731-6b75-4dfa-b76c-ee83bdf17eaa',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1156.779639] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9672ecd6-e064-4287-b1ae-4b673c86ae96 in Status: SUCCESS [ 1156.779859] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9672ecd6-e064-4287-b1ae-4b673c86ae96" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.780103] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9672ecd6-e064-4287-b1ae-4b673c86ae96" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.780245] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9672ecd6-e064-4287-b1ae-4b673c86ae96" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.780447] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.780566] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.780630] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.780784] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.780872] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.780964] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9672ecd6-e064-4287-b1ae-4b673c86ae96" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.781072] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9672ecd6-e064-4287-b1ae-4b673c86ae96',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1157.001702] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.001702] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.001702] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.002072] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.002072] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.002072] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3bf31731-6b75-4dfa-b76c-ee83bdf17eaa is going to be created. [ 1157.027849] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.028095] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.028147] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.028331] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.028498] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.041481] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3bf31731-6b75-4dfa-b76c-ee83bdf17eaa in Status: UNINITIALIZED for 2s [ 1157.287013] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9672ecd6-e064-4287-b1ae-4b673c86ae96',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1157.791258] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9672ecd6-e064-4287-b1ae-4b673c86ae96: rpc.has_security_group_logging(os_id): False [ 1157.820025] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.820025] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.820025] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.820025] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.820025] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.820025] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.820025] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.820025] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.820025] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.820025] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.820025] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9672ecd6-e064-4287-b1ae-4b673c86ae96 is going to be created. [ 1157.855401] env[65306]: INFO networking_nsxv3.common.synchronization [req-bfc4aa15-8e56-4a23-9565-44a5aca9d9a1 req-b76b8653-6fe4-488d-be2c-8da16ca3e57f tempest-DeleteServersTestJSON-1340326246 tempest-DeleteServersTestJSON-1340326246-project-member] Enqueued Resource ID: d82bad56-9830-4c7d-9763-6d8a05e0998c with Priority: HIGHEST for action security_group_members [ 1157.855994] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d82bad56-9830-4c7d-9763-6d8a05e0998c with Priority: HIGHEST for action security_group_members [ 1157.856546] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-d82bad56-9830-4c7d-9763-6d8a05e0998c taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.856546] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d82bad56-9830-4c7d-9763-6d8a05e0998c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.856648] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d82bad56-9830-4c7d-9763-6d8a05e0998c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.857364] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d82bad56-9830-4c7d-9763-6d8a05e0998c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.857364] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.857364] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.857364] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.857364] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.857364] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.857364] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d82bad56-9830-4c7d-9763-6d8a05e0998c',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1157.908647] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.908820] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.908865] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.909164] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.909344] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.923776] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9672ecd6-e064-4287-b1ae-4b673c86ae96 in Status: IN_PROGRESS for 2s [ 1158.359125] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.359291] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.359367] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.359582] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.359672] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.359866] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.359963] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.360057] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.360211] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.360285] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.360378] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d82bad56-9830-4c7d-9763-6d8a05e0998c is going to be updated. [ 1158.391998] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.392184] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.392256] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.392466] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.392613] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.402329] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d82bad56-9830-4c7d-9763-6d8a05e0998c in Status: IN_PROGRESS for 2s [ 1159.052183] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3bf31731-6b75-4dfa-b76c-ee83bdf17eaa in Status: SUCCESS [ 1159.052183] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3bf31731-6b75-4dfa-b76c-ee83bdf17eaa" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.052550] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3bf31731-6b75-4dfa-b76c-ee83bdf17eaa" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.052550] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3bf31731-6b75-4dfa-b76c-ee83bdf17eaa" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.052784] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.052939] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.052939] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.052939] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.053198] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.053198] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3bf31731-6b75-4dfa-b76c-ee83bdf17eaa" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.053388] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3bf31731-6b75-4dfa-b76c-ee83bdf17eaa',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1159.558567] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3bf31731-6b75-4dfa-b76c-ee83bdf17eaa',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1159.937459] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9672ecd6-e064-4287-b1ae-4b673c86ae96 in Status: SUCCESS [ 1159.937459] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9672ecd6-e064-4287-b1ae-4b673c86ae96" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.060585] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3bf31731-6b75-4dfa-b76c-ee83bdf17eaa: rpc.has_security_group_logging(os_id): False [ 1160.081353] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.081516] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.081563] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.081809] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.081873] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.082213] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.082325] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.082389] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.082569] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.082648] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.082739] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3bf31731-6b75-4dfa-b76c-ee83bdf17eaa is going to be created. [ 1160.142937] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.143195] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.143195] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.143329] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.143545] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.156272] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3bf31731-6b75-4dfa-b76c-ee83bdf17eaa in Status: IN_PROGRESS for 2s [ 1160.414733] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d82bad56-9830-4c7d-9763-6d8a05e0998c in Status: SUCCESS [ 1160.415136] env[65306]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d82bad56-9830-4c7d-9763-6d8a05e0998c deletion is rescheduled due to dependency. [ 1160.415136] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d82bad56-9830-4c7d-9763-6d8a05e0998c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.610744] env[65306]: INFO networking_nsxv3.common.synchronization [req-36d9a47c-4f71-4664-8548-84d838695ce7 req-04067e51-6869-4bfe-9e0b-4ba63ce88318 tempest-ServersTestJSON-1773114292 tempest-ServersTestJSON-1773114292-project-member] Enqueued Resource ID: 0cb41b0f-cdd2-4222-95b4-bafd614b7460 with Priority: HIGHEST for action security_group_members [ 1160.611329] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0cb41b0f-cdd2-4222-95b4-bafd614b7460 with Priority: HIGHEST for action security_group_members [ 1160.611656] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-0cb41b0f-cdd2-4222-95b4-bafd614b7460 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.611746] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0cb41b0f-cdd2-4222-95b4-bafd614b7460" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.612485] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0cb41b0f-cdd2-4222-95b4-bafd614b7460" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.612485] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0cb41b0f-cdd2-4222-95b4-bafd614b7460" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.612485] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.612485] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.612695] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.612789] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.612873] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.612963] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0cb41b0f-cdd2-4222-95b4-bafd614b7460',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1161.004927] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock network-949 taken with stack trace [, , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.005279] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "network-949" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.005347] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "network-949" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.005602] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "network-949" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.005888] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.006075] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.006208] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.006914] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.006914] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.006914] env[65306]: DEBUG dogpile.cache.region [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] No value present for key: 'zone-id' {{(pid=65306) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1161.006914] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] NeedRegenerationException {{(pid=65306) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1161.007334] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] no value, waiting for create lock {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1161.007334] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] value creation lock acquired {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1161.007334] env[65306]: DEBUG dogpile.cache.region [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] No value present for key: 'zone-id' {{(pid=65306) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1161.007334] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Calling creation function for not-yet-present value {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1161.007469] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1161.082049] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1161.082049] env[65306]: DEBUG dogpile.cache.region [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Cache value generated in 0.074 seconds for key(s): 'zone-id' {{(pid=65306) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1161.082496] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Released creation lock {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1161.082496] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "network-949" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.082614] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock port-cd0ea608-00b5-4593-8bb2-bd379c008ec2 taken with stack trace [, , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.082788] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "port-cd0ea608-00b5-4593-8bb2-bd379c008ec2" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.082909] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "port-cd0ea608-00b5-4593-8bb2-bd379c008ec2" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.083266] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "port-cd0ea608-00b5-4593-8bb2-bd379c008ec2" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.083410] env[65306]: DEBUG networking_nsxv3.api.rpc [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cd0ea608-00b5-4593-8bb2-bd379c008ec2',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1161.115426] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0cb41b0f-cdd2-4222-95b4-bafd614b7460',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1161.586330] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.586572] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.586707] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.586981] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.587179] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.587359] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Segment Port cd0ea608-00b5-4593-8bb2-bd379c008ec2 not found, creating... [ 1161.587623] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.587801] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.587920] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.588159] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.588305] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.588628] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.588787] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.588919] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.589156] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.589314] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.589458] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Resource: SegmentPort with ID: cd0ea608-00b5-4593-8bb2-bd379c008ec2 is going to be created. [ 1161.611459] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.611677] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.611793] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.612170] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.612495] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.612759] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "port-cd0ea608-00b5-4593-8bb2-bd379c008ec2" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.617341] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0cb41b0f-cdd2-4222-95b4-bafd614b7460',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1162.119741] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.120226] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.120226] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.120226] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.120346] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.120393] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0cb41b0f-cdd2-4222-95b4-bafd614b7460 is going to be updated. [ 1162.151685] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.151842] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.151907] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.152186] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.152342] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.162917] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0cb41b0f-cdd2-4222-95b4-bafd614b7460 in Status: IN_PROGRESS for 2s [ 1162.168199] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3bf31731-6b75-4dfa-b76c-ee83bdf17eaa in Status: SUCCESS [ 1162.168503] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3bf31731-6b75-4dfa-b76c-ee83bdf17eaa" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.295681] env[65306]: INFO networking_nsxv3.common.synchronization [req-36d9a47c-4f71-4664-8548-84d838695ce7 req-11916d71-2a68-4a6e-89b1-90c813e3cf31 service nova] Enqueued Resource ID: 0cb41b0f-cdd2-4222-95b4-bafd614b7460 with Priority: HIGHEST for action security_group_rules [ 1162.295935] env[65306]: INFO networking_nsxv3.common.synchronization [req-36d9a47c-4f71-4664-8548-84d838695ce7 req-11916d71-2a68-4a6e-89b1-90c813e3cf31 service nova] Enqueued Resource ID: 0cb41b0f-cdd2-4222-95b4-bafd614b7460 with Priority: HIGHEST for action security_group_members [ 1162.296143] env[65306]: INFO networking_nsxv3.common.synchronization [req-36d9a47c-4f71-4664-8548-84d838695ce7 req-11916d71-2a68-4a6e-89b1-90c813e3cf31 service nova] Enqueued Resource ID: cd0ea608-00b5-4593-8bb2-bd379c008ec2 with Priority: HIGHEST for action port [ 1162.296796] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0cb41b0f-cdd2-4222-95b4-bafd614b7460 with Priority: HIGHEST for action security_group_rules [ 1162.296979] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0cb41b0f-cdd2-4222-95b4-bafd614b7460 with Priority: HIGHEST for action security_group_members [ 1162.297264] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cd0ea608-00b5-4593-8bb2-bd379c008ec2 with Priority: HIGHEST for action port [ 1162.297497] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0cb41b0f-cdd2-4222-95b4-bafd614b7460 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.297656] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0cb41b0f-cdd2-4222-95b4-bafd614b7460" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.297746] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0cb41b0f-cdd2-4222-95b4-bafd614b7460" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.298018] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0cb41b0f-cdd2-4222-95b4-bafd614b7460" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.298156] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0cb41b0f-cdd2-4222-95b4-bafd614b7460',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1162.299395] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-0cb41b0f-cdd2-4222-95b4-bafd614b7460 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.299505] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0cb41b0f-cdd2-4222-95b4-bafd614b7460" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.299837] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock port-cd0ea608-00b5-4593-8bb2-bd379c008ec2 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.299980] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cd0ea608-00b5-4593-8bb2-bd379c008ec2" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.300088] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cd0ea608-00b5-4593-8bb2-bd379c008ec2" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.300331] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cd0ea608-00b5-4593-8bb2-bd379c008ec2" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.300479] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cd0ea608-00b5-4593-8bb2-bd379c008ec2',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1162.596308] env[65306]: INFO networking_nsxv3.common.synchronization [req-b6ae9d3f-731f-4b94-a9aa-03c7997ef3c1 req-77b17787-b3a6-4473-9016-3c3390dff6b0 tempest-AttachInterfacesTestJSON-144464476 tempest-AttachInterfacesTestJSON-144464476-project-member] Enqueued Resource ID: 60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d with Priority: HIGHEST for action security_group_members [ 1162.596862] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d with Priority: HIGHEST for action security_group_members [ 1162.597207] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.597341] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.597415] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.597649] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.597802] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.599328] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.599418] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.599569] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.599657] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.599973] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1162.806032] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-0cb41b0f-cdd2-4222-95b4-bafd614b7460 taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.806032] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0cb41b0f-cdd2-4222-95b4-bafd614b7460" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.806032] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port cd0ea608-00b5-4593-8bb2-bd379c008ec2 with status ACTIVE [ 1162.806032] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.806032] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.806032] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.806032] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.806032] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.806032] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.806032] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.806867] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.806867] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.806867] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.806867] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.806867] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.806867] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.806867] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.807396] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.807396] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: cd0ea608-00b5-4593-8bb2-bd379c008ec2 is going to be updated. [ 1162.830186] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.830401] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.830505] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.830788] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.830987] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.831239] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cd0ea608-00b5-4593-8bb2-bd379c008ec2" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.930911] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock network-540 taken with stack trace [, , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.931157] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "network-540" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.931348] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "network-540" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.931571] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "network-540" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.931825] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.932051] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.932338] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.932584] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.932736] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.932953] env[65306]: DEBUG dogpile.cache.region [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] No value present for key: 'zone-id' {{(pid=65306) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1162.933085] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] NeedRegenerationException {{(pid=65306) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1162.933185] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] no value, waiting for create lock {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1162.933347] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] value creation lock acquired {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1162.933581] env[65306]: DEBUG dogpile.cache.region [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] No value present for key: 'zone-id' {{(pid=65306) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1162.934629] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Calling creation function for not-yet-present value {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1162.934629] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1162.960035] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1162.960035] env[65306]: DEBUG dogpile.cache.region [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=65306) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1162.960035] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Released creation lock {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1162.960268] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "network-540" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.960522] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock port-cb90760d-c9e0-4c4f-80b9-b0a7c5c377b2 taken with stack trace [, , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.961121] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "port-cb90760d-c9e0-4c4f-80b9-b0a7c5c377b2" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.961121] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "port-cb90760d-c9e0-4c4f-80b9-b0a7c5c377b2" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.961241] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "port-cb90760d-c9e0-4c4f-80b9-b0a7c5c377b2" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.961316] env[65306]: DEBUG networking_nsxv3.api.rpc [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cb90760d-c9e0-4c4f-80b9-b0a7c5c377b2',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1163.101629] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.101871] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.101871] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.102077] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.102187] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.102349] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.102471] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.102568] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.102689] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.102761] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.102853] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d is going to be updated. [ 1163.134263] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.134833] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.134833] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.134833] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.135076] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.145263] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d in Status: IN_PROGRESS for 2s [ 1163.464124] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.464402] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.464555] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.465201] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.465201] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.465201] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Segment Port cb90760d-c9e0-4c4f-80b9-b0a7c5c377b2 not found, creating... [ 1163.465533] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.465702] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.465823] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.466068] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.466828] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.466828] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.466828] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.466828] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.467045] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.467166] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.468139] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Resource: SegmentPort with ID: cb90760d-c9e0-4c4f-80b9-b0a7c5c377b2 is going to be created. [ 1163.493029] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.493160] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.493199] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.493505] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.493735] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.493961] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "port-cb90760d-c9e0-4c4f-80b9-b0a7c5c377b2" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.180824] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0cb41b0f-cdd2-4222-95b4-bafd614b7460 in Status: SUCCESS [ 1164.180824] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0cb41b0f-cdd2-4222-95b4-bafd614b7460" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.180824] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0cb41b0f-cdd2-4222-95b4-bafd614b7460" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.180824] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0cb41b0f-cdd2-4222-95b4-bafd614b7460" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.180824] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.180824] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.180824] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.180824] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.180824] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.180824] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0cb41b0f-cdd2-4222-95b4-bafd614b7460',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1164.215675] env[65306]: INFO networking_nsxv3.common.synchronization [req-b6ae9d3f-731f-4b94-a9aa-03c7997ef3c1 req-5870ac4a-4455-47d5-b997-ae1d1b5755e7 service nova] Enqueued Resource ID: 60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d with Priority: HIGHEST for action security_group_rules [ 1164.216142] env[65306]: INFO networking_nsxv3.common.synchronization [req-b6ae9d3f-731f-4b94-a9aa-03c7997ef3c1 req-5870ac4a-4455-47d5-b997-ae1d1b5755e7 service nova] Enqueued Resource ID: 60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d with Priority: HIGHEST for action security_group_members [ 1164.216505] env[65306]: INFO networking_nsxv3.common.synchronization [req-b6ae9d3f-731f-4b94-a9aa-03c7997ef3c1 req-5870ac4a-4455-47d5-b997-ae1d1b5755e7 service nova] Enqueued Resource ID: cb90760d-c9e0-4c4f-80b9-b0a7c5c377b2 with Priority: HIGHEST for action port [ 1164.217245] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d with Priority: HIGHEST for action security_group_rules [ 1164.217552] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d with Priority: HIGHEST for action security_group_members [ 1164.217900] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cb90760d-c9e0-4c4f-80b9-b0a7c5c377b2 with Priority: HIGHEST for action port [ 1164.219667] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock rules-60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.219667] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.219667] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.219667] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.219667] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1164.220688] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.221100] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.221216] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock port-cb90760d-c9e0-4c4f-80b9-b0a7c5c377b2 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.222674] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cb90760d-c9e0-4c4f-80b9-b0a7c5c377b2" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.222674] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cb90760d-c9e0-4c4f-80b9-b0a7c5c377b2" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.222674] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cb90760d-c9e0-4c4f-80b9-b0a7c5c377b2" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.222674] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cb90760d-c9e0-4c4f-80b9-b0a7c5c377b2',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1164.684515] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0cb41b0f-cdd2-4222-95b4-bafd614b7460',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1164.722452] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.722452] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.726733] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port cb90760d-c9e0-4c4f-80b9-b0a7c5c377b2 with status ACTIVE [ 1164.726977] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.727732] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.727732] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.727732] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.727732] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.727732] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.727953] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.727953] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.727953] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.728043] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.728231] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.728324] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.728387] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.728527] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.728591] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.728678] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: cb90760d-c9e0-4c4f-80b9-b0a7c5c377b2 is going to be updated. [ 1164.750145] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.750335] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.750335] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.752492] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.752492] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.752492] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cb90760d-c9e0-4c4f-80b9-b0a7c5c377b2" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.157524] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d in Status: SUCCESS [ 1165.157524] env[65306]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d deletion is rescheduled due to dependency. [ 1165.157524] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.157524] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.157524] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.157524] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.157524] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.157524] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.157524] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.157524] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.157524] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1165.187508] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0cb41b0f-cdd2-4222-95b4-bafd614b7460',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1165.661210] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1165.689742] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.689934] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.690047] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.690334] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.690456] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.690595] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0cb41b0f-cdd2-4222-95b4-bafd614b7460 is going to be updated. [ 1165.724366] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.724517] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.724581] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.724827] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.724981] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.737029] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0cb41b0f-cdd2-4222-95b4-bafd614b7460 in Status: IN_PROGRESS for 2s [ 1166.164288] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1166.666722] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.667095] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.667095] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.667334] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.667429] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.667574] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d is going to be updated. [ 1166.701247] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.701490] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.701490] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.701782] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.702022] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.713872] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d in Status: IN_PROGRESS for 2s [ 1167.746879] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0cb41b0f-cdd2-4222-95b4-bafd614b7460 in Status: SUCCESS [ 1167.747204] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0cb41b0f-cdd2-4222-95b4-bafd614b7460" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.747306] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0cb41b0f-cdd2-4222-95b4-bafd614b7460" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.747503] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0cb41b0f-cdd2-4222-95b4-bafd614b7460" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.747699] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.747874] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.747874] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.748034] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.748120] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.748208] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0cb41b0f-cdd2-4222-95b4-bafd614b7460" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.748299] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0cb41b0f-cdd2-4222-95b4-bafd614b7460',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1168.031698] env[65306]: INFO networking_nsxv3.common.synchronization [req-049ba89e-7a59-472c-9489-7850c3527efa req-4c1e4721-a40c-4650-8abd-49edfbd66ee2 tempest-DeleteServersTestJSON-1340326246 tempest-DeleteServersTestJSON-1340326246-project-member] Enqueued Resource ID: d82bad56-9830-4c7d-9763-6d8a05e0998c with Priority: HIGHEST for action security_group_members [ 1168.032443] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d82bad56-9830-4c7d-9763-6d8a05e0998c with Priority: HIGHEST for action security_group_members [ 1168.032830] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-d82bad56-9830-4c7d-9763-6d8a05e0998c taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.032830] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d82bad56-9830-4c7d-9763-6d8a05e0998c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.032830] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d82bad56-9830-4c7d-9763-6d8a05e0998c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.033095] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d82bad56-9830-4c7d-9763-6d8a05e0998c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.033221] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.033328] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.033384] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.033552] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.033639] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.033735] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d82bad56-9830-4c7d-9763-6d8a05e0998c',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1168.250381] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-0cb41b0f-cdd2-4222-95b4-bafd614b7460 taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.250578] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0cb41b0f-cdd2-4222-95b4-bafd614b7460" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.250623] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0cb41b0f-cdd2-4222-95b4-bafd614b7460" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.250867] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0cb41b0f-cdd2-4222-95b4-bafd614b7460" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.251630] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.251630] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.251630] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.251630] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.251630] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.251876] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0cb41b0f-cdd2-4222-95b4-bafd614b7460" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.251876] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-0cb41b0f-cdd2-4222-95b4-bafd614b7460 taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.251988] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0cb41b0f-cdd2-4222-95b4-bafd614b7460" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.252158] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0cb41b0f-cdd2-4222-95b4-bafd614b7460" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.252256] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0cb41b0f-cdd2-4222-95b4-bafd614b7460" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.252428] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.253027] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.253027] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.253027] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.253027] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.253027] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0cb41b0f-cdd2-4222-95b4-bafd614b7460" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.253292] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0cb41b0f-cdd2-4222-95b4-bafd614b7460',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1168.426371] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock network-591 taken with stack trace [, , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.426519] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "network-591" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.427022] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "network-591" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.427022] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "network-591" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.427188] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.427358] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.427495] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.427710] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.427855] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.428077] env[65306]: DEBUG dogpile.cache.region [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] No value present for key: 'zone-id' {{(pid=65306) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1168.428385] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] NeedRegenerationException {{(pid=65306) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1168.428385] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] no value, waiting for create lock {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1168.428385] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] value creation lock acquired {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1168.428590] env[65306]: DEBUG dogpile.cache.region [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] No value present for key: 'zone-id' {{(pid=65306) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1168.428635] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Calling creation function for not-yet-present value {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1168.428749] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1168.450295] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1168.450652] env[65306]: DEBUG dogpile.cache.region [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65306) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1168.450794] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Released creation lock {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1168.450982] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "network-591" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.451317] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock port-d0090042-e55a-4d59-a231-83e50466f00e taken with stack trace [, , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.451557] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "port-d0090042-e55a-4d59-a231-83e50466f00e" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.451624] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "port-d0090042-e55a-4d59-a231-83e50466f00e" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.452133] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "port-d0090042-e55a-4d59-a231-83e50466f00e" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.452441] env[65306]: DEBUG networking_nsxv3.api.rpc [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d0090042-e55a-4d59-a231-83e50466f00e',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1168.538380] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.538546] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.538622] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.538844] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.538938] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.539145] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.539249] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.539314] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.539465] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.539541] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.539640] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d82bad56-9830-4c7d-9763-6d8a05e0998c is going to be updated. [ 1168.564711] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.564917] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.564917] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.565146] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.565300] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.574026] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d82bad56-9830-4c7d-9763-6d8a05e0998c in Status: IN_PROGRESS for 2s [ 1168.726120] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d in Status: SUCCESS [ 1168.726484] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.727239] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.727479] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.727687] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.727807] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.727874] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.728088] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.728271] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.728336] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.728367] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1168.755482] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0cb41b0f-cdd2-4222-95b4-bafd614b7460: rpc.has_security_group_logging(os_id): False [ 1168.773941] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.774221] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.774386] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.774650] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.774776] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.775020] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.775230] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.775330] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.775520] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.775607] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.775850] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.775982] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.776090] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.776266] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.776356] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.776615] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.776723] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.776830] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.776974] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.777068] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.777186] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0cb41b0f-cdd2-4222-95b4-bafd614b7460 is going to be updated. [ 1168.846724] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.846905] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.846953] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.847171] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.847331] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.863627] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0cb41b0f-cdd2-4222-95b4-bafd614b7460 in Status: IN_PROGRESS for 2s [ 1168.958034] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.958034] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.958034] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.958034] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.958034] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.958034] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Segment Port d0090042-e55a-4d59-a231-83e50466f00e not found, creating... [ 1168.958034] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.958034] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.958034] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.958034] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.958034] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.958509] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.958509] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.958509] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.958509] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.958509] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.958509] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Resource: SegmentPort with ID: d0090042-e55a-4d59-a231-83e50466f00e is going to be created. [ 1168.987039] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.987227] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.987349] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.987737] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.988017] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.988295] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "port-d0090042-e55a-4d59-a231-83e50466f00e" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.180088] env[65306]: INFO networking_nsxv3.common.synchronization [None req-9610d813-dc01-4101-a246-022304c57b4b tempest-AttachInterfacesTestJSON-144464476 tempest-AttachInterfacesTestJSON-144464476-project-member] Enqueued Resource ID: 60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d with Priority: HIGHEST for action security_group_members [ 1169.180652] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d with Priority: HIGHEST for action security_group_members [ 1169.180965] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.181417] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.181495] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.181698] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.181891] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.181968] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.182061] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.182254] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.182308] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.182409] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1169.231792] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.232718] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.686062] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1169.715657] env[65306]: INFO networking_nsxv3.common.synchronization [req-049ba89e-7a59-472c-9489-7850c3527efa req-903b916a-1945-4792-b764-25d4ddb0600e service nova] Enqueued Resource ID: d82bad56-9830-4c7d-9763-6d8a05e0998c with Priority: HIGHEST for action security_group_rules [ 1169.716080] env[65306]: INFO networking_nsxv3.common.synchronization [req-049ba89e-7a59-472c-9489-7850c3527efa req-903b916a-1945-4792-b764-25d4ddb0600e service nova] Enqueued Resource ID: d82bad56-9830-4c7d-9763-6d8a05e0998c with Priority: HIGHEST for action security_group_members [ 1169.716080] env[65306]: INFO networking_nsxv3.common.synchronization [req-049ba89e-7a59-472c-9489-7850c3527efa req-903b916a-1945-4792-b764-25d4ddb0600e service nova] Enqueued Resource ID: d0090042-e55a-4d59-a231-83e50466f00e with Priority: HIGHEST for action port [ 1169.716666] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d82bad56-9830-4c7d-9763-6d8a05e0998c with Priority: HIGHEST for action security_group_rules [ 1169.716865] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d82bad56-9830-4c7d-9763-6d8a05e0998c with Priority: HIGHEST for action security_group_members [ 1169.717042] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d0090042-e55a-4d59-a231-83e50466f00e with Priority: HIGHEST for action port [ 1169.717243] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d82bad56-9830-4c7d-9763-6d8a05e0998c taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.717373] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d82bad56-9830-4c7d-9763-6d8a05e0998c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.717443] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d82bad56-9830-4c7d-9763-6d8a05e0998c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.717684] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d82bad56-9830-4c7d-9763-6d8a05e0998c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.717782] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d82bad56-9830-4c7d-9763-6d8a05e0998c',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1169.720168] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-d82bad56-9830-4c7d-9763-6d8a05e0998c taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.720241] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d82bad56-9830-4c7d-9763-6d8a05e0998c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.720456] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock port-d0090042-e55a-4d59-a231-83e50466f00e taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.720642] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d0090042-e55a-4d59-a231-83e50466f00e" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.720642] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d0090042-e55a-4d59-a231-83e50466f00e" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.720809] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d0090042-e55a-4d59-a231-83e50466f00e" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.720887] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d0090042-e55a-4d59-a231-83e50466f00e',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1170.188914] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1170.223759] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-d82bad56-9830-4c7d-9763-6d8a05e0998c taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.223973] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d82bad56-9830-4c7d-9763-6d8a05e0998c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.224102] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d0090042-e55a-4d59-a231-83e50466f00e with status ACTIVE [ 1170.224333] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.224498] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.224538] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.224764] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.224880] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.225518] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.225518] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.225518] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.225518] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.225518] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.226013] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.226013] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.226013] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.226013] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.226242] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.226242] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d0090042-e55a-4d59-a231-83e50466f00e is going to be updated. [ 1170.251183] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.251469] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.251569] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.251855] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.252112] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.252302] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d0090042-e55a-4d59-a231-83e50466f00e" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.584996] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d82bad56-9830-4c7d-9763-6d8a05e0998c in Status: SUCCESS [ 1170.584996] env[65306]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d82bad56-9830-4c7d-9763-6d8a05e0998c deletion is rescheduled due to dependency. [ 1170.585216] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d82bad56-9830-4c7d-9763-6d8a05e0998c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.585326] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d82bad56-9830-4c7d-9763-6d8a05e0998c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.585533] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d82bad56-9830-4c7d-9763-6d8a05e0998c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.585735] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.585857] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.585931] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.586090] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.586170] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.586277] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d82bad56-9830-4c7d-9763-6d8a05e0998c',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1170.691813] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.692102] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.692102] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.692325] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.692581] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.692710] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d is going to be updated. [ 1170.726678] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.726900] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.726900] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.727113] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.727259] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.737812] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d in Status: IN_PROGRESS for 2s [ 1170.881416] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0cb41b0f-cdd2-4222-95b4-bafd614b7460 in Status: SUCCESS [ 1170.881627] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0cb41b0f-cdd2-4222-95b4-bafd614b7460" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.892849] env[65306]: INFO networking_nsxv3.common.synchronization [req-1b10985d-7820-4fcc-8a03-8ad0c562e684 req-be9c7001-7385-4f6a-9f1b-5395dbf72ae1 tempest-AttachVolumeShelveTestJSON-1351401733 tempest-AttachVolumeShelveTestJSON-1351401733-project-member] Enqueued Resource ID: 4ccf00ad-53bf-45d0-a342-260b14c2ccf2 with Priority: HIGHEST for action security_group_members [ 1170.893659] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4ccf00ad-53bf-45d0-a342-260b14c2ccf2 with Priority: HIGHEST for action security_group_members [ 1170.894758] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-4ccf00ad-53bf-45d0-a342-260b14c2ccf2 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.894758] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4ccf00ad-53bf-45d0-a342-260b14c2ccf2" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.894758] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4ccf00ad-53bf-45d0-a342-260b14c2ccf2" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.895144] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4ccf00ad-53bf-45d0-a342-260b14c2ccf2" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.895183] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.895399] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.895450] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.895723] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.895899] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.896427] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4ccf00ad-53bf-45d0-a342-260b14c2ccf2',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1171.088341] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d82bad56-9830-4c7d-9763-6d8a05e0998c',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1171.398951] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.399361] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.399361] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.399443] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.399473] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.399662] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.399763] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.399825] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.399970] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.400054] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.400142] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4ccf00ad-53bf-45d0-a342-260b14c2ccf2 is going to be updated. [ 1171.429318] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.429485] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.429571] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.429824] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.430008] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.439170] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock network-540 taken with stack trace [, , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.439414] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "network-540" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.439550] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "network-540" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.439813] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "network-540" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.440121] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.440308] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.440454] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.440769] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.440948] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.441181] env[65306]: DEBUG dogpile.cache.region [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] No value present for key: 'zone-id' {{(pid=65306) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1171.441298] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] NeedRegenerationException {{(pid=65306) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1171.441515] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] no value, waiting for create lock {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1171.441621] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] value creation lock acquired {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1171.441728] env[65306]: DEBUG dogpile.cache.region [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] No value present for key: 'zone-id' {{(pid=65306) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1171.441832] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Calling creation function for not-yet-present value {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1171.442713] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1171.444475] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4ccf00ad-53bf-45d0-a342-260b14c2ccf2 in Status: IN_PROGRESS for 2s [ 1171.465526] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1171.465706] env[65306]: DEBUG dogpile.cache.region [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65306) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1171.465853] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Released creation lock {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1171.466054] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "network-540" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.466409] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock port-daa7bb2a-1fa9-4028-a011-dd11c8d6a9bb taken with stack trace [, , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.466632] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "port-daa7bb2a-1fa9-4028-a011-dd11c8d6a9bb" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.466755] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "port-daa7bb2a-1fa9-4028-a011-dd11c8d6a9bb" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.467098] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "port-daa7bb2a-1fa9-4028-a011-dd11c8d6a9bb" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.467251] env[65306]: DEBUG networking_nsxv3.api.rpc [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('daa7bb2a-1fa9-4028-a011-dd11c8d6a9bb',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1171.593464] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d82bad56-9830-4c7d-9763-6d8a05e0998c',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1171.969909] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.970186] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.970312] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.970596] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.970751] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.970912] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Segment Port daa7bb2a-1fa9-4028-a011-dd11c8d6a9bb not found, creating... [ 1171.971174] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.971333] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.971458] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.971786] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.971978] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.972335] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.972595] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.972730] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.973054] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.973263] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.973464] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Resource: SegmentPort with ID: daa7bb2a-1fa9-4028-a011-dd11c8d6a9bb is going to be created. [ 1171.997289] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.997630] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.997719] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.997961] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.998248] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.998532] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "port-daa7bb2a-1fa9-4028-a011-dd11c8d6a9bb" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.096098] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.096412] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.096519] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.096832] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.096939] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.097078] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d82bad56-9830-4c7d-9763-6d8a05e0998c is going to be updated. [ 1172.148371] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.148567] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.148607] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.148798] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.148937] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.162263] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d82bad56-9830-4c7d-9763-6d8a05e0998c in Status: IN_PROGRESS for 2s [ 1172.749574] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d in Status: SUCCESS [ 1172.749965] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.749965] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.750187] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.750395] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.750514] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.750580] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.750740] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.750816] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.750931] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.751078] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.751172] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.751233] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.751368] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.751508] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.751599] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.751674] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.751815] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.751890] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.751972] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.752093] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1173.129197] env[65306]: INFO networking_nsxv3.common.synchronization [req-90a501db-c543-4830-8dcd-9a7840633fce req-e8b155b1-b70d-4abc-94bd-99aed1c77cef service nova] Enqueued Resource ID: 60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d with Priority: HIGHEST for action security_group_rules [ 1173.129197] env[65306]: INFO networking_nsxv3.common.synchronization [req-90a501db-c543-4830-8dcd-9a7840633fce req-e8b155b1-b70d-4abc-94bd-99aed1c77cef service nova] Enqueued Resource ID: 60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d with Priority: HIGHEST for action security_group_members [ 1173.129388] env[65306]: INFO networking_nsxv3.common.synchronization [req-90a501db-c543-4830-8dcd-9a7840633fce req-e8b155b1-b70d-4abc-94bd-99aed1c77cef service nova] Enqueued Resource ID: daa7bb2a-1fa9-4028-a011-dd11c8d6a9bb with Priority: HIGHEST for action port [ 1173.130439] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d with Priority: HIGHEST for action security_group_rules [ 1173.130536] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d with Priority: HIGHEST for action security_group_members [ 1173.130982] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: daa7bb2a-1fa9-4028-a011-dd11c8d6a9bb with Priority: HIGHEST for action port [ 1173.131462] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock rules-60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.131606] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.131851] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.132510] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.132647] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.132890] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.133078] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.133221] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.133309] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.133588] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.133643] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.133724] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1173.134790] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock port-daa7bb2a-1fa9-4028-a011-dd11c8d6a9bb taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.134995] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-daa7bb2a-1fa9-4028-a011-dd11c8d6a9bb" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.134995] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-daa7bb2a-1fa9-4028-a011-dd11c8d6a9bb" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.135296] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-daa7bb2a-1fa9-4028-a011-dd11c8d6a9bb" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.135296] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('daa7bb2a-1fa9-4028-a011-dd11c8d6a9bb',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1173.255063] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d: rpc.has_security_group_logging(os_id): False [ 1173.274590] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.274785] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.274834] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.275244] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.275244] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.275346] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.275407] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.275457] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.275954] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.275954] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.275954] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.275954] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.276316] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.276316] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.276316] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.276513] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.276741] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.276874] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.277109] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.277285] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.277951] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d is going to be updated. [ 1173.353256] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.353458] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.353560] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.353830] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.354014] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.368741] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d in Status: IN_PROGRESS for 2s [ 1173.464079] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4ccf00ad-53bf-45d0-a342-260b14c2ccf2 in Status: SUCCESS [ 1173.464318] env[65306]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4ccf00ad-53bf-45d0-a342-260b14c2ccf2 deletion is rescheduled due to dependency. [ 1173.464359] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4ccf00ad-53bf-45d0-a342-260b14c2ccf2" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.638557] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1173.639248] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port daa7bb2a-1fa9-4028-a011-dd11c8d6a9bb with status ACTIVE [ 1173.639456] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.639579] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.639647] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.639870] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.639968] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.640259] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.640259] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.640374] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.640582] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.640652] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.640904] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.641057] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.641114] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.641484] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.641484] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.641484] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: daa7bb2a-1fa9-4028-a011-dd11c8d6a9bb is going to be updated. [ 1173.668038] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.668038] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.668328] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.668391] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.668580] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.668843] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-daa7bb2a-1fa9-4028-a011-dd11c8d6a9bb" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.143447] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1174.175955] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d82bad56-9830-4c7d-9763-6d8a05e0998c in Status: SUCCESS [ 1174.176231] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d82bad56-9830-4c7d-9763-6d8a05e0998c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.176416] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d82bad56-9830-4c7d-9763-6d8a05e0998c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.176699] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d82bad56-9830-4c7d-9763-6d8a05e0998c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.176912] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.177053] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.177125] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.177287] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.177369] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.177458] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d82bad56-9830-4c7d-9763-6d8a05e0998c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.177554] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d82bad56-9830-4c7d-9763-6d8a05e0998c',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1174.646948] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.647203] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.647324] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.647576] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.647710] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.647871] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d is going to be updated. [ 1174.678833] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.679043] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.679043] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.679294] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.679518] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.680936] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-d82bad56-9830-4c7d-9763-6d8a05e0998c taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.681025] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d82bad56-9830-4c7d-9763-6d8a05e0998c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.681064] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d82bad56-9830-4c7d-9763-6d8a05e0998c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.681390] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d82bad56-9830-4c7d-9763-6d8a05e0998c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.681390] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.681516] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.681602] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.681703] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.681742] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.681848] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d82bad56-9830-4c7d-9763-6d8a05e0998c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.681967] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-d82bad56-9830-4c7d-9763-6d8a05e0998c taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.682060] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d82bad56-9830-4c7d-9763-6d8a05e0998c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.682122] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d82bad56-9830-4c7d-9763-6d8a05e0998c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.682309] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d82bad56-9830-4c7d-9763-6d8a05e0998c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.682435] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.682542] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.682602] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.682735] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.682817] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.682883] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d82bad56-9830-4c7d-9763-6d8a05e0998c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.682967] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d82bad56-9830-4c7d-9763-6d8a05e0998c',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1174.693454] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d in Status: IN_PROGRESS for 2s [ 1175.185483] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d82bad56-9830-4c7d-9763-6d8a05e0998c: rpc.has_security_group_logging(os_id): False [ 1175.203382] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.203527] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.203599] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.203809] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.203922] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.204094] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.204248] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.204300] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.204472] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.204550] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.204926] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.205035] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.205035] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.205185] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.205402] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.205448] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.205515] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.205574] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.205708] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.205780] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.205868] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d82bad56-9830-4c7d-9763-6d8a05e0998c is going to be updated. [ 1175.275789] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.276085] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.276257] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.276604] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.276787] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.298087] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d82bad56-9830-4c7d-9763-6d8a05e0998c in Status: IN_PROGRESS for 2s [ 1175.387290] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d in Status: SUCCESS [ 1175.387534] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.387708] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.387949] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.388098] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1175.890248] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.890388] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.175837] env[65306]: INFO networking_nsxv3.common.synchronization [req-466f40a3-fda4-4583-bff3-c65fc291aafe req-40f2e987-ab54-4006-a0fc-39c8ce731056 tempest-ImagesOneServerTestJSON-691374835 tempest-ImagesOneServerTestJSON-691374835-project-member] Enqueued Resource ID: 1dfcba8d-33df-4f0e-919e-4904bde851ad with Priority: HIGHEST for action security_group_members [ 1176.176533] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1dfcba8d-33df-4f0e-919e-4904bde851ad with Priority: HIGHEST for action security_group_members [ 1176.176917] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-1dfcba8d-33df-4f0e-919e-4904bde851ad taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.177060] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1dfcba8d-33df-4f0e-919e-4904bde851ad" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.177146] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1dfcba8d-33df-4f0e-919e-4904bde851ad" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.177373] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1dfcba8d-33df-4f0e-919e-4904bde851ad" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.177556] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.177908] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.177908] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.177908] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.178087] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.178140] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1dfcba8d-33df-4f0e-919e-4904bde851ad',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1176.680671] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.681150] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.681150] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.681287] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.681429] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.681718] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.681885] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.681980] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.682248] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.682361] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.682504] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1dfcba8d-33df-4f0e-919e-4904bde851ad is going to be updated. [ 1176.704710] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d in Status: SUCCESS [ 1176.704992] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.705176] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.705421] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.705630] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.705740] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.705829] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.705958] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.706046] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.706136] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.706225] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1176.717683] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.717683] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.717683] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.717683] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.717683] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.728509] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1dfcba8d-33df-4f0e-919e-4904bde851ad in Status: IN_PROGRESS for 2s [ 1177.209131] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.209295] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.209374] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.209600] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.209766] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.209867] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.209933] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.210093] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.210180] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.210268] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.210416] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.210508] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.210569] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.210706] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.210850] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.210941] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.210999] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.211148] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.211222] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.211320] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.211420] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1177.325110] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d82bad56-9830-4c7d-9763-6d8a05e0998c in Status: SUCCESS [ 1177.325368] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d82bad56-9830-4c7d-9763-6d8a05e0998c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.376298] env[65306]: INFO networking_nsxv3.common.synchronization [req-4ca14d6e-ee7e-45a2-a1fb-1ed5e51529ca req-69bdf88a-5cfa-44ed-a4cd-a63691721338 tempest-ServersTestJSON-1773114292 tempest-ServersTestJSON-1773114292-project-member] Enqueued Resource ID: 0cb41b0f-cdd2-4222-95b4-bafd614b7460 with Priority: HIGHEST for action security_group_members [ 1177.376935] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0cb41b0f-cdd2-4222-95b4-bafd614b7460 with Priority: HIGHEST for action security_group_members [ 1177.377345] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-0cb41b0f-cdd2-4222-95b4-bafd614b7460 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.377498] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0cb41b0f-cdd2-4222-95b4-bafd614b7460" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.377596] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0cb41b0f-cdd2-4222-95b4-bafd614b7460" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.377848] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0cb41b0f-cdd2-4222-95b4-bafd614b7460" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.378069] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.378214] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.378292] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.378491] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.378616] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.378751] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0cb41b0f-cdd2-4222-95b4-bafd614b7460',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1177.713905] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d: rpc.has_security_group_logging(os_id): False [ 1177.735631] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.735800] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.735849] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.736085] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.736183] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.736381] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.736483] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.736587] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.736740] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.736819] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.737035] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.737124] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.737170] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.737317] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.737392] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.737578] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.737673] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.737737] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.737875] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.737950] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.738057] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d is going to be updated. [ 1177.835517] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.835757] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.835852] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.836151] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.836369] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.850373] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d in Status: IN_PROGRESS for 2s [ 1177.885622] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0cb41b0f-cdd2-4222-95b4-bafd614b7460',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1177.901997] env[65306]: INFO networking_nsxv3.common.synchronization [None req-58fc0ddc-8b4d-49fb-9178-cffef6177e93 tempest-AttachVolumeShelveTestJSON-1351401733 tempest-AttachVolumeShelveTestJSON-1351401733-project-member] Enqueued Resource ID: e84d3263-5312-46e3-9331-fbbe9b6a7e85 with Priority: HIGHEST for action security_group_rules [ 1177.903072] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e84d3263-5312-46e3-9331-fbbe9b6a7e85 with Priority: HIGHEST for action security_group_rules [ 1177.903458] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e84d3263-5312-46e3-9331-fbbe9b6a7e85 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.903596] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e84d3263-5312-46e3-9331-fbbe9b6a7e85" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.903666] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e84d3263-5312-46e3-9331-fbbe9b6a7e85" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.903945] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e84d3263-5312-46e3-9331-fbbe9b6a7e85" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.904049] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e84d3263-5312-46e3-9331-fbbe9b6a7e85',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1178.024499] env[65306]: INFO networking_nsxv3.common.synchronization [None req-86244770-6015-48db-b3f1-7fa13be04b85 tempest-AttachVolumeShelveTestJSON-1351401733 tempest-AttachVolumeShelveTestJSON-1351401733-project-member] Enqueued Resource ID: e84d3263-5312-46e3-9331-fbbe9b6a7e85 with Priority: HIGHEST for action security_group_rules [ 1178.024499] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e84d3263-5312-46e3-9331-fbbe9b6a7e85 with Priority: HIGHEST for action security_group_rules [ 1178.024714] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e84d3263-5312-46e3-9331-fbbe9b6a7e85 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.024816] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e84d3263-5312-46e3-9331-fbbe9b6a7e85" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.388695] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0cb41b0f-cdd2-4222-95b4-bafd614b7460',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1178.438402] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.438599] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.438639] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.439049] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.439049] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.439160] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e84d3263-5312-46e3-9331-fbbe9b6a7e85 already deleted. [ 1178.439585] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e84d3263-5312-46e3-9331-fbbe9b6a7e85" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.439585] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e84d3263-5312-46e3-9331-fbbe9b6a7e85" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.439585] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e84d3263-5312-46e3-9331-fbbe9b6a7e85" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.439668] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e84d3263-5312-46e3-9331-fbbe9b6a7e85',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1178.744089] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1dfcba8d-33df-4f0e-919e-4904bde851ad in Status: SUCCESS [ 1178.744089] env[65306]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1dfcba8d-33df-4f0e-919e-4904bde851ad deletion is rescheduled due to dependency. [ 1178.744671] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1dfcba8d-33df-4f0e-919e-4904bde851ad" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.891175] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.891329] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.891401] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.891736] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.891905] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.892066] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0cb41b0f-cdd2-4222-95b4-bafd614b7460 is going to be updated. [ 1178.934513] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.934708] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.934748] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.934950] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.935099] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.953612] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0cb41b0f-cdd2-4222-95b4-bafd614b7460 in Status: IN_PROGRESS for 2s [ 1178.963122] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.963282] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.963350] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.963571] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.963658] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.963757] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e84d3263-5312-46e3-9331-fbbe9b6a7e85 already deleted. [ 1178.963839] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e84d3263-5312-46e3-9331-fbbe9b6a7e85" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.866900] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d in Status: SUCCESS [ 1179.867266] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.965629] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0cb41b0f-cdd2-4222-95b4-bafd614b7460 in Status: SUCCESS [ 1180.965949] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0cb41b0f-cdd2-4222-95b4-bafd614b7460" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.011191] env[65306]: INFO networking_nsxv3.common.synchronization [req-195fd6f4-9cff-4aa8-a12b-5b4a9cb4bb76 req-2171802e-0fbf-4ac7-85e9-6bc51f4fc0b9 tempest-DeleteServersTestJSON-1340326246 tempest-DeleteServersTestJSON-1340326246-project-member] Enqueued Resource ID: d82bad56-9830-4c7d-9763-6d8a05e0998c with Priority: HIGHEST for action security_group_members [ 1182.011191] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d82bad56-9830-4c7d-9763-6d8a05e0998c with Priority: HIGHEST for action security_group_members [ 1182.011487] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-d82bad56-9830-4c7d-9763-6d8a05e0998c taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.011487] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d82bad56-9830-4c7d-9763-6d8a05e0998c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.011581] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d82bad56-9830-4c7d-9763-6d8a05e0998c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.011709] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d82bad56-9830-4c7d-9763-6d8a05e0998c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.011851] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.011943] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.012010] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.012152] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.012231] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.012322] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d82bad56-9830-4c7d-9763-6d8a05e0998c',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1182.514519] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.514811] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.514975] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.515357] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.515665] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.515879] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.516197] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.516315] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.516651] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.517611] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.517611] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d82bad56-9830-4c7d-9763-6d8a05e0998c is going to be updated. [ 1182.553541] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.553754] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.553867] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.554278] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.554472] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.568272] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d82bad56-9830-4c7d-9763-6d8a05e0998c in Status: IN_PROGRESS for 2s [ 1184.580436] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d82bad56-9830-4c7d-9763-6d8a05e0998c in Status: SUCCESS [ 1184.580789] env[65306]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d82bad56-9830-4c7d-9763-6d8a05e0998c deletion is rescheduled due to dependency. [ 1184.580828] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d82bad56-9830-4c7d-9763-6d8a05e0998c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.882913] env[65306]: INFO networking_nsxv3.common.synchronization [req-028cdd87-d5a2-441e-a289-2712d894ef75 req-8a72bc9d-ee37-4b70-a121-fa8a1e8af6dc tempest-AttachInterfacesTestJSON-144464476 tempest-AttachInterfacesTestJSON-144464476-project-member] Enqueued Resource ID: 60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d with Priority: HIGHEST for action security_group_members [ 1185.884206] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d with Priority: HIGHEST for action security_group_members [ 1185.884206] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.884206] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.884206] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.884435] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.884646] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.884801] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.884871] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.885059] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.885153] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.885267] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1186.123430] env[65306]: INFO networking_nsxv3.common.synchronization [req-c2f746ca-8539-4027-a82c-3309c0a60932 req-50ec03c9-c422-4ef5-ac9f-04516c50b3ff tempest-AttachVolumeShelveTestJSON-1351401733 tempest-AttachVolumeShelveTestJSON-1351401733-project-member] Enqueued Resource ID: e84d3263-5312-46e3-9331-fbbe9b6a7e85 with Priority: HIGHEST for action security_group_members [ 1186.124115] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e84d3263-5312-46e3-9331-fbbe9b6a7e85 with Priority: HIGHEST for action security_group_members [ 1186.124731] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-e84d3263-5312-46e3-9331-fbbe9b6a7e85 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.124731] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e84d3263-5312-46e3-9331-fbbe9b6a7e85" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.124731] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e84d3263-5312-46e3-9331-fbbe9b6a7e85" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.125069] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e84d3263-5312-46e3-9331-fbbe9b6a7e85" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.125272] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.125384] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.125468] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.125633] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.125717] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.125821] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e84d3263-5312-46e3-9331-fbbe9b6a7e85',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1186.254372] env[65306]: INFO networking_nsxv3.common.synchronization [None req-d2866835-fc2c-4b9d-b50a-dca7c46dc9a1 tempest-AttachInterfacesTestJSON-144464476 tempest-AttachInterfacesTestJSON-144464476-project-member] Enqueued Resource ID: 60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d with Priority: HIGHEST for action security_group_members [ 1186.255089] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d with Priority: HIGHEST for action security_group_members [ 1186.255414] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.255540] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.389398] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1186.502104] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock network-270 taken with stack trace [, , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.503134] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "network-270" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.503134] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "network-270" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.503134] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "network-270" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.503134] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.503327] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.503391] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.503606] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.503747] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.503953] env[65306]: DEBUG dogpile.cache.region [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] No value present for key: 'zone-id' {{(pid=65306) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1186.504094] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] NeedRegenerationException {{(pid=65306) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1186.504245] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] no value, waiting for create lock {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1186.504396] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] value creation lock acquired {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1186.504503] env[65306]: DEBUG dogpile.cache.region [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] No value present for key: 'zone-id' {{(pid=65306) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1186.504608] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Calling creation function for not-yet-present value {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1186.504742] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1186.525257] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1186.525483] env[65306]: DEBUG dogpile.cache.region [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65306) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1186.525628] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Released creation lock {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1186.525819] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "network-270" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.526198] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock port-341fc765-f45c-46ba-abd4-bb9992b32b9c taken with stack trace [, , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.526381] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "port-341fc765-f45c-46ba-abd4-bb9992b32b9c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.526503] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "port-341fc765-f45c-46ba-abd4-bb9992b32b9c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.526832] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "port-341fc765-f45c-46ba-abd4-bb9992b32b9c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.526971] env[65306]: DEBUG networking_nsxv3.api.rpc [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('341fc765-f45c-46ba-abd4-bb9992b32b9c',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1186.628295] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.628490] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.628565] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.628742] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.628838] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.629052] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.629165] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.629274] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.629487] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.629598] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.629700] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e84d3263-5312-46e3-9331-fbbe9b6a7e85 already deleted. [ 1186.629790] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e84d3263-5312-46e3-9331-fbbe9b6a7e85" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.729599] env[65306]: INFO networking_nsxv3.common.synchronization [req-1586fe7e-1db7-42af-a116-19fd1072ebde req-c681a79e-e797-4ae7-b6c3-0b6777aa78c0 tempest-ServersTestJSON-1773114292 tempest-ServersTestJSON-1773114292-project-member] Enqueued Resource ID: 0cb41b0f-cdd2-4222-95b4-bafd614b7460 with Priority: HIGHEST for action security_group_members [ 1186.730151] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0cb41b0f-cdd2-4222-95b4-bafd614b7460 with Priority: HIGHEST for action security_group_members [ 1186.730541] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-0cb41b0f-cdd2-4222-95b4-bafd614b7460 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.730728] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0cb41b0f-cdd2-4222-95b4-bafd614b7460" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.730806] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0cb41b0f-cdd2-4222-95b4-bafd614b7460" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.731015] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0cb41b0f-cdd2-4222-95b4-bafd614b7460" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.731210] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.731318] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.731382] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.731541] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.731631] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.731727] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0cb41b0f-cdd2-4222-95b4-bafd614b7460',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1186.890706] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1187.029535] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.029820] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.029985] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.030314] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.030477] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.030650] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Segment Port 341fc765-f45c-46ba-abd4-bb9992b32b9c not found, creating... [ 1187.030916] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.031083] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.031202] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.031442] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.031584] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.031919] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.032124] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.032309] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.032459] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.032605] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.032748] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Resource: SegmentPort with ID: 341fc765-f45c-46ba-abd4-bb9992b32b9c is going to be created. [ 1187.056935] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.057176] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.057290] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.057567] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.057805] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.058066] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "port-341fc765-f45c-46ba-abd4-bb9992b32b9c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.235191] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.235475] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.235550] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.235776] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.235930] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.236365] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.236438] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.236491] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.236641] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.236715] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.236922] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0cb41b0f-cdd2-4222-95b4-bafd614b7460 is going to be updated. [ 1187.271181] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.271413] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.271592] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.271831] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.272014] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.283381] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0cb41b0f-cdd2-4222-95b4-bafd614b7460 in Status: IN_PROGRESS for 2s [ 1187.393270] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.393493] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.393493] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.393633] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.393743] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.394445] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d is going to be updated. [ 1187.425390] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.425567] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.425643] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.425867] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.426017] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.442899] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d in Status: IN_PROGRESS for 2s [ 1187.840381] env[65306]: INFO networking_nsxv3.common.synchronization [req-c2f746ca-8539-4027-a82c-3309c0a60932 req-f409cf6a-222d-4c32-bcb9-9f9758442024 service nova] Enqueued Resource ID: e84d3263-5312-46e3-9331-fbbe9b6a7e85 with Priority: HIGHEST for action security_group_rules [ 1187.840600] env[65306]: INFO networking_nsxv3.common.synchronization [req-c2f746ca-8539-4027-a82c-3309c0a60932 req-f409cf6a-222d-4c32-bcb9-9f9758442024 service nova] Enqueued Resource ID: e84d3263-5312-46e3-9331-fbbe9b6a7e85 with Priority: HIGHEST for action security_group_members [ 1187.840779] env[65306]: INFO networking_nsxv3.common.synchronization [req-c2f746ca-8539-4027-a82c-3309c0a60932 req-f409cf6a-222d-4c32-bcb9-9f9758442024 service nova] Enqueued Resource ID: 341fc765-f45c-46ba-abd4-bb9992b32b9c with Priority: HIGHEST for action port [ 1187.841692] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e84d3263-5312-46e3-9331-fbbe9b6a7e85 with Priority: HIGHEST for action security_group_rules [ 1187.841857] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e84d3263-5312-46e3-9331-fbbe9b6a7e85 with Priority: HIGHEST for action security_group_members [ 1187.842099] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 341fc765-f45c-46ba-abd4-bb9992b32b9c with Priority: HIGHEST for action port [ 1187.842376] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e84d3263-5312-46e3-9331-fbbe9b6a7e85 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.842539] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e84d3263-5312-46e3-9331-fbbe9b6a7e85" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.842610] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e84d3263-5312-46e3-9331-fbbe9b6a7e85" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.842849] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e84d3263-5312-46e3-9331-fbbe9b6a7e85" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.843071] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e84d3263-5312-46e3-9331-fbbe9b6a7e85',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1187.843947] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-e84d3263-5312-46e3-9331-fbbe9b6a7e85 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.844088] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e84d3263-5312-46e3-9331-fbbe9b6a7e85" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.844162] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e84d3263-5312-46e3-9331-fbbe9b6a7e85" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.844412] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e84d3263-5312-46e3-9331-fbbe9b6a7e85" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.844580] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.844767] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.844767] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.845689] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.845809] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.845976] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e84d3263-5312-46e3-9331-fbbe9b6a7e85',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1187.848513] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock port-341fc765-f45c-46ba-abd4-bb9992b32b9c taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.848513] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-341fc765-f45c-46ba-abd4-bb9992b32b9c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.848513] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-341fc765-f45c-46ba-abd4-bb9992b32b9c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.848783] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-341fc765-f45c-46ba-abd4-bb9992b32b9c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.848874] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('341fc765-f45c-46ba-abd4-bb9992b32b9c',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1188.350785] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-e84d3263-5312-46e3-9331-fbbe9b6a7e85 taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.351107] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e84d3263-5312-46e3-9331-fbbe9b6a7e85" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.353351] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 341fc765-f45c-46ba-abd4-bb9992b32b9c with status ACTIVE [ 1188.353642] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.353736] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.353774] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.353971] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.354073] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.354254] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.354353] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.354465] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.354624] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.354702] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.354887] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.354982] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.355374] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.355374] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.355374] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.355374] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 341fc765-f45c-46ba-abd4-bb9992b32b9c is going to be updated. [ 1188.356593] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e84d3263-5312-46e3-9331-fbbe9b6a7e85',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1188.382478] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.382675] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.382675] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.382947] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.383148] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.383342] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-341fc765-f45c-46ba-abd4-bb9992b32b9c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.859287] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e84d3263-5312-46e3-9331-fbbe9b6a7e85',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1188.927999] env[65306]: INFO networking_nsxv3.common.synchronization [req-6b7d753a-6909-4265-aa75-a23efc743d92 req-56046dbc-29d7-4e21-8799-2f80df361751 tempest-AttachInterfacesTestJSON-144464476 tempest-AttachInterfacesTestJSON-144464476-project-member] Enqueued Resource ID: 4603b17e-9032-4f9f-a8ac-9d7d5e34db46 with Priority: HIGHEST for action security_group_members [ 1188.928612] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4603b17e-9032-4f9f-a8ac-9d7d5e34db46 with Priority: HIGHEST for action security_group_members [ 1188.929668] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-4603b17e-9032-4f9f-a8ac-9d7d5e34db46 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.929668] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4603b17e-9032-4f9f-a8ac-9d7d5e34db46" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.929668] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4603b17e-9032-4f9f-a8ac-9d7d5e34db46" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.929668] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4603b17e-9032-4f9f-a8ac-9d7d5e34db46" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.929668] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.929668] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.929668] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.930013] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.930013] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.930013] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4603b17e-9032-4f9f-a8ac-9d7d5e34db46',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1189.294146] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0cb41b0f-cdd2-4222-95b4-bafd614b7460 in Status: SUCCESS [ 1189.294319] env[65306]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0cb41b0f-cdd2-4222-95b4-bafd614b7460 deletion is rescheduled due to dependency. [ 1189.294432] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0cb41b0f-cdd2-4222-95b4-bafd614b7460" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.362043] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.362434] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.362434] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.362616] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.362687] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.362810] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e84d3263-5312-46e3-9331-fbbe9b6a7e85 is going to be created. [ 1189.388615] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.388837] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.388837] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.389153] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.389340] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.401773] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e84d3263-5312-46e3-9331-fbbe9b6a7e85 in Status: UNINITIALIZED for 2s [ 1189.432493] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.432699] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.432774] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.432998] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.433107] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.433309] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.433410] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.433475] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.433634] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.433726] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.433817] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4603b17e-9032-4f9f-a8ac-9d7d5e34db46 is going to be updated. [ 1189.452234] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d in Status: SUCCESS [ 1189.452415] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.452610] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.452863] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.453088] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.453237] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.453317] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.453501] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.453605] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.453705] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1189.462960] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.463132] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.463200] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.463386] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.463581] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.477081] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4603b17e-9032-4f9f-a8ac-9d7d5e34db46 in Status: IN_PROGRESS for 2s [ 1189.956374] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.956577] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.956652] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.956912] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.957019] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.957272] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.957380] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.957512] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.957681] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.957727] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.957797] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d is going to be updated. [ 1189.992098] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.992280] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.992440] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.992674] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.992817] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.002907] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d in Status: IN_PROGRESS for 2s [ 1191.414057] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e84d3263-5312-46e3-9331-fbbe9b6a7e85 in Status: SUCCESS [ 1191.414535] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e84d3263-5312-46e3-9331-fbbe9b6a7e85" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.414621] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e84d3263-5312-46e3-9331-fbbe9b6a7e85" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.414903] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e84d3263-5312-46e3-9331-fbbe9b6a7e85" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.415206] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.415372] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.415464] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.415699] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.415805] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.415886] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e84d3263-5312-46e3-9331-fbbe9b6a7e85" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.415966] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e84d3263-5312-46e3-9331-fbbe9b6a7e85',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1191.487669] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4603b17e-9032-4f9f-a8ac-9d7d5e34db46 in Status: SUCCESS [ 1191.487913] env[65306]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4603b17e-9032-4f9f-a8ac-9d7d5e34db46 deletion is rescheduled due to dependency. [ 1191.488012] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4603b17e-9032-4f9f-a8ac-9d7d5e34db46" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.919089] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e84d3263-5312-46e3-9331-fbbe9b6a7e85',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1192.013107] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d in Status: SUCCESS [ 1192.013282] env[65306]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d deletion is rescheduled due to dependency. [ 1192.013403] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.421175] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e84d3263-5312-46e3-9331-fbbe9b6a7e85: rpc.has_security_group_logging(os_id): False [ 1192.445831] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.445831] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.445831] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.446444] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.446444] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.446444] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.446444] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.446575] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.446774] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.446774] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.446969] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e84d3263-5312-46e3-9331-fbbe9b6a7e85 is going to be created. [ 1192.509143] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.509298] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.509377] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.509583] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.509767] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.520680] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e84d3263-5312-46e3-9331-fbbe9b6a7e85 in Status: IN_PROGRESS for 2s [ 1193.929614] env[65306]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1193.930418] env[65306]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1194.561021] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e84d3263-5312-46e3-9331-fbbe9b6a7e85 in Status: SUCCESS [ 1194.561266] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e84d3263-5312-46e3-9331-fbbe9b6a7e85" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.895056] env[65306]: INFO networking_nsxv3.common.synchronization [req-0a085736-d43f-492e-90c9-7d784ff33f64 req-616019f0-6b0a-4828-9db5-d82fff2f9928 tempest-DeleteServersTestJSON-1340326246 tempest-DeleteServersTestJSON-1340326246-project-member] Enqueued Resource ID: d82bad56-9830-4c7d-9763-6d8a05e0998c with Priority: HIGHEST for action security_group_members [ 1194.895880] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d82bad56-9830-4c7d-9763-6d8a05e0998c with Priority: HIGHEST for action security_group_members [ 1194.896948] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-d82bad56-9830-4c7d-9763-6d8a05e0998c taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.896948] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d82bad56-9830-4c7d-9763-6d8a05e0998c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.896948] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d82bad56-9830-4c7d-9763-6d8a05e0998c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.896948] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d82bad56-9830-4c7d-9763-6d8a05e0998c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.897272] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.897272] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.897272] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.897448] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.897448] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.897554] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d82bad56-9830-4c7d-9763-6d8a05e0998c',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1195.227657] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock network-591 taken with stack trace [, , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.228109] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "network-591" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.228240] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "network-591" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.228466] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "network-591" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.228852] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.229053] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.229173] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.229476] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.229677] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.229959] env[65306]: DEBUG dogpile.cache.region [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] No value present for key: 'zone-id' {{(pid=65306) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1195.230154] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] NeedRegenerationException {{(pid=65306) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1195.230281] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] no value, waiting for create lock {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1195.230422] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] value creation lock acquired {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1195.230523] env[65306]: DEBUG dogpile.cache.region [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] No value present for key: 'zone-id' {{(pid=65306) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1195.230630] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Calling creation function for not-yet-present value {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1195.230776] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1195.266938] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1195.267093] env[65306]: DEBUG dogpile.cache.region [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Cache value generated in 0.036 seconds for key(s): 'zone-id' {{(pid=65306) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1195.267227] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Released creation lock {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1195.267465] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "network-591" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.267858] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock port-c30fc00f-84d0-4319-86b7-f9f38baa91ae taken with stack trace [, , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.268321] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "port-c30fc00f-84d0-4319-86b7-f9f38baa91ae" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.268321] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "port-c30fc00f-84d0-4319-86b7-f9f38baa91ae" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.268551] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "port-c30fc00f-84d0-4319-86b7-f9f38baa91ae" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.268712] env[65306]: DEBUG networking_nsxv3.api.rpc [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c30fc00f-84d0-4319-86b7-f9f38baa91ae',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1195.400091] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.400284] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.400284] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.400513] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.400604] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.400808] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.400907] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.400998] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.401180] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.401260] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.401348] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d82bad56-9830-4c7d-9763-6d8a05e0998c is going to be updated. [ 1195.429306] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.429406] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.429498] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.429772] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.429825] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.440793] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d82bad56-9830-4c7d-9763-6d8a05e0998c in Status: IN_PROGRESS for 2s [ 1195.771564] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.771800] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.771929] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.772239] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.772411] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.772650] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Segment Port c30fc00f-84d0-4319-86b7-f9f38baa91ae not found, creating... [ 1195.772990] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.773183] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.773301] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.773533] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.773676] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.773957] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.774124] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.774241] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.774442] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.774652] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.774797] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Resource: SegmentPort with ID: c30fc00f-84d0-4319-86b7-f9f38baa91ae is going to be created. [ 1195.804582] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.804829] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.804956] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.805246] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.805483] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.805739] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "port-c30fc00f-84d0-4319-86b7-f9f38baa91ae" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.530163] env[65306]: INFO networking_nsxv3.common.synchronization [req-0a085736-d43f-492e-90c9-7d784ff33f64 req-d5ad337e-765b-4e01-a4fc-82bfb929619a service nova] Enqueued Resource ID: d82bad56-9830-4c7d-9763-6d8a05e0998c with Priority: HIGHEST for action security_group_rules [ 1196.530163] env[65306]: INFO networking_nsxv3.common.synchronization [req-0a085736-d43f-492e-90c9-7d784ff33f64 req-d5ad337e-765b-4e01-a4fc-82bfb929619a service nova] Enqueued Resource ID: d82bad56-9830-4c7d-9763-6d8a05e0998c with Priority: HIGHEST for action security_group_members [ 1196.530466] env[65306]: INFO networking_nsxv3.common.synchronization [req-0a085736-d43f-492e-90c9-7d784ff33f64 req-d5ad337e-765b-4e01-a4fc-82bfb929619a service nova] Enqueued Resource ID: c30fc00f-84d0-4319-86b7-f9f38baa91ae with Priority: HIGHEST for action port [ 1196.530827] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d82bad56-9830-4c7d-9763-6d8a05e0998c with Priority: HIGHEST for action security_group_rules [ 1196.530992] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d82bad56-9830-4c7d-9763-6d8a05e0998c with Priority: HIGHEST for action security_group_members [ 1196.531118] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c30fc00f-84d0-4319-86b7-f9f38baa91ae with Priority: HIGHEST for action port [ 1196.531397] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d82bad56-9830-4c7d-9763-6d8a05e0998c taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.531524] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d82bad56-9830-4c7d-9763-6d8a05e0998c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.531591] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d82bad56-9830-4c7d-9763-6d8a05e0998c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.531791] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d82bad56-9830-4c7d-9763-6d8a05e0998c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.531984] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d82bad56-9830-4c7d-9763-6d8a05e0998c',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1196.532740] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-d82bad56-9830-4c7d-9763-6d8a05e0998c taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.532833] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d82bad56-9830-4c7d-9763-6d8a05e0998c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.533018] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock port-c30fc00f-84d0-4319-86b7-f9f38baa91ae taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.533120] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c30fc00f-84d0-4319-86b7-f9f38baa91ae" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.533184] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c30fc00f-84d0-4319-86b7-f9f38baa91ae" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.533630] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c30fc00f-84d0-4319-86b7-f9f38baa91ae" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.533630] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c30fc00f-84d0-4319-86b7-f9f38baa91ae',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1197.035720] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-d82bad56-9830-4c7d-9763-6d8a05e0998c taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.035910] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d82bad56-9830-4c7d-9763-6d8a05e0998c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.036916] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c30fc00f-84d0-4319-86b7-f9f38baa91ae with status ACTIVE [ 1197.036916] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.036916] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.036916] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.036916] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.036916] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.037214] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.037214] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.037214] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.037417] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.037541] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.037834] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.037940] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.038047] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.038690] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.038690] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.038690] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c30fc00f-84d0-4319-86b7-f9f38baa91ae is going to be updated. [ 1197.071090] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.071090] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.071090] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.071090] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.071090] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.071090] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c30fc00f-84d0-4319-86b7-f9f38baa91ae" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.451341] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d82bad56-9830-4c7d-9763-6d8a05e0998c in Status: SUCCESS [ 1197.451526] env[65306]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d82bad56-9830-4c7d-9763-6d8a05e0998c deletion is rescheduled due to dependency. [ 1197.451633] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d82bad56-9830-4c7d-9763-6d8a05e0998c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.451802] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d82bad56-9830-4c7d-9763-6d8a05e0998c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.452286] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d82bad56-9830-4c7d-9763-6d8a05e0998c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.452491] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.452602] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.452665] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.452819] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.452918] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.452992] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d82bad56-9830-4c7d-9763-6d8a05e0998c',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1197.589594] env[65306]: INFO networking_nsxv3.common.synchronization [None req-d4b2bba5-f7fc-4950-9f4f-ada76d62bcca tempest-AttachInterfacesTestJSON-144464476 tempest-AttachInterfacesTestJSON-144464476-project-member] Enqueued Resource ID: a70508b0-bb5b-4d0d-af41-b80fbdcfe90e with Priority: HIGHEST for action security_group_rules [ 1197.590163] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a70508b0-bb5b-4d0d-af41-b80fbdcfe90e with Priority: HIGHEST for action security_group_rules [ 1197.590698] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a70508b0-bb5b-4d0d-af41-b80fbdcfe90e taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.590698] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a70508b0-bb5b-4d0d-af41-b80fbdcfe90e" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.590698] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a70508b0-bb5b-4d0d-af41-b80fbdcfe90e" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.591180] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a70508b0-bb5b-4d0d-af41-b80fbdcfe90e" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.591351] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a70508b0-bb5b-4d0d-af41-b80fbdcfe90e',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1197.801801] env[65306]: INFO networking_nsxv3.common.synchronization [None req-ef1e70ae-5b8e-4d27-a5b7-863e4deef015 tempest-AttachInterfacesTestJSON-144464476 tempest-AttachInterfacesTestJSON-144464476-project-member] Enqueued Resource ID: a70508b0-bb5b-4d0d-af41-b80fbdcfe90e with Priority: HIGHEST for action security_group_rules [ 1197.802417] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a70508b0-bb5b-4d0d-af41-b80fbdcfe90e with Priority: HIGHEST for action security_group_rules [ 1197.802666] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a70508b0-bb5b-4d0d-af41-b80fbdcfe90e taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.802773] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a70508b0-bb5b-4d0d-af41-b80fbdcfe90e" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.955594] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d82bad56-9830-4c7d-9763-6d8a05e0998c',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1197.968734] env[65306]: INFO networking_nsxv3.common.synchronization [req-ae082443-85e1-4d5d-b4dd-675338a21db0 req-cbe48a7e-86ed-43eb-b6fc-d99f99df0d05 tempest-AttachVolumeNegativeTest-723798471 tempest-AttachVolumeNegativeTest-723798471-project-member] Enqueued Resource ID: 52d329d0-14c2-4610-ad32-9ade5237bab0 with Priority: HIGHEST for action security_group_members [ 1197.968734] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 52d329d0-14c2-4610-ad32-9ade5237bab0 with Priority: HIGHEST for action security_group_members [ 1197.968734] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-52d329d0-14c2-4610-ad32-9ade5237bab0 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.968734] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-52d329d0-14c2-4610-ad32-9ade5237bab0" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.968734] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-52d329d0-14c2-4610-ad32-9ade5237bab0" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.968734] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-52d329d0-14c2-4610-ad32-9ade5237bab0" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.968734] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.968734] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.968734] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.968734] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.968734] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.969146] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('52d329d0-14c2-4610-ad32-9ade5237bab0',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1198.115242] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.115242] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.115242] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.115242] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.115242] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.115242] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a70508b0-bb5b-4d0d-af41-b80fbdcfe90e already deleted. [ 1198.115242] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a70508b0-bb5b-4d0d-af41-b80fbdcfe90e" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.115242] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a70508b0-bb5b-4d0d-af41-b80fbdcfe90e" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.115242] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a70508b0-bb5b-4d0d-af41-b80fbdcfe90e" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.115242] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a70508b0-bb5b-4d0d-af41-b80fbdcfe90e',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1198.457749] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d82bad56-9830-4c7d-9763-6d8a05e0998c',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1198.474113] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.474113] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.474113] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.474113] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.474113] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.474113] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.474113] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.474113] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.474113] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.474113] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.474113] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 52d329d0-14c2-4610-ad32-9ade5237bab0 is going to be updated. [ 1198.515702] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.515702] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.515702] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.515702] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.516136] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.526961] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 52d329d0-14c2-4610-ad32-9ade5237bab0 in Status: IN_PROGRESS for 2s [ 1198.645259] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.645542] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.645542] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.645726] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.645772] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.645850] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a70508b0-bb5b-4d0d-af41-b80fbdcfe90e already deleted. [ 1198.645935] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a70508b0-bb5b-4d0d-af41-b80fbdcfe90e" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.962874] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.963174] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.963174] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.964038] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.964038] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.964038] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d82bad56-9830-4c7d-9763-6d8a05e0998c is going to be updated. [ 1199.002607] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.002607] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.002832] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.002892] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.003242] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.012779] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d82bad56-9830-4c7d-9763-6d8a05e0998c in Status: IN_PROGRESS for 2s [ 1200.536377] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 52d329d0-14c2-4610-ad32-9ade5237bab0 in Status: SUCCESS [ 1200.536739] env[65306]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 52d329d0-14c2-4610-ad32-9ade5237bab0 deletion is rescheduled due to dependency. [ 1200.536739] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-52d329d0-14c2-4610-ad32-9ade5237bab0" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.024466] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d82bad56-9830-4c7d-9763-6d8a05e0998c in Status: SUCCESS [ 1201.024851] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d82bad56-9830-4c7d-9763-6d8a05e0998c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.025168] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d82bad56-9830-4c7d-9763-6d8a05e0998c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.025547] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d82bad56-9830-4c7d-9763-6d8a05e0998c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.025874] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.026079] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.026205] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.026498] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.026621] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.026738] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d82bad56-9830-4c7d-9763-6d8a05e0998c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.026883] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d82bad56-9830-4c7d-9763-6d8a05e0998c',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1201.529064] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-d82bad56-9830-4c7d-9763-6d8a05e0998c taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.529305] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d82bad56-9830-4c7d-9763-6d8a05e0998c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.529305] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d82bad56-9830-4c7d-9763-6d8a05e0998c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.529457] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d82bad56-9830-4c7d-9763-6d8a05e0998c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.529627] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.529731] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.529780] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.529933] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.530032] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.530123] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d82bad56-9830-4c7d-9763-6d8a05e0998c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.530272] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-d82bad56-9830-4c7d-9763-6d8a05e0998c taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.530388] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d82bad56-9830-4c7d-9763-6d8a05e0998c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.530448] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d82bad56-9830-4c7d-9763-6d8a05e0998c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.530587] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d82bad56-9830-4c7d-9763-6d8a05e0998c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.530727] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.530819] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.530880] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.531054] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.531132] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.531213] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d82bad56-9830-4c7d-9763-6d8a05e0998c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.531343] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d82bad56-9830-4c7d-9763-6d8a05e0998c',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1202.033453] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d82bad56-9830-4c7d-9763-6d8a05e0998c: rpc.has_security_group_logging(os_id): False [ 1202.068671] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.069033] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.069177] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.069537] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.069691] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.070177] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.070430] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.070430] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.070754] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.070918] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.071214] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.071380] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.071453] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.071676] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.071823] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.073069] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.073311] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.073439] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.073678] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.073786] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.073891] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d82bad56-9830-4c7d-9763-6d8a05e0998c is going to be updated. [ 1202.149912] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.150208] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.150208] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.150405] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.150573] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.166928] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d82bad56-9830-4c7d-9763-6d8a05e0998c in Status: IN_PROGRESS for 2s [ 1202.217317] env[65306]: INFO networking_nsxv3.common.synchronization [req-e70c6c56-f0a1-4a7b-88d7-4eda2431b1c4 req-6071dc5a-5003-4811-bc1e-8984824f77f1 tempest-ServerActionsTestJSON-437813836 tempest-ServerActionsTestJSON-437813836-project-member] Enqueued Resource ID: 6e403189-fcac-40e3-aa50-4c17f4d29895 with Priority: HIGHEST for action security_group_members [ 1202.218038] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6e403189-fcac-40e3-aa50-4c17f4d29895 with Priority: HIGHEST for action security_group_members [ 1202.218446] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-6e403189-fcac-40e3-aa50-4c17f4d29895 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.218446] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6e403189-fcac-40e3-aa50-4c17f4d29895" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.218446] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6e403189-fcac-40e3-aa50-4c17f4d29895" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.218654] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6e403189-fcac-40e3-aa50-4c17f4d29895" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.218763] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.218858] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.218918] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.219249] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.219461] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.219461] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6e403189-fcac-40e3-aa50-4c17f4d29895',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1202.721994] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.722248] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.722335] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.722570] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.722678] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.722876] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.722974] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.723351] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.723351] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.723351] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.723492] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6e403189-fcac-40e3-aa50-4c17f4d29895 is going to be updated. [ 1202.751475] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.751718] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.751813] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.752060] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.752297] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.763685] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6e403189-fcac-40e3-aa50-4c17f4d29895 in Status: IN_PROGRESS for 2s [ 1203.037187] env[65306]: INFO networking_nsxv3.common.synchronization [None req-c243c106-e105-4acb-ad77-b057809e2139 tempest-AttachVolumeNegativeTest-723798471 tempest-AttachVolumeNegativeTest-723798471-project-member] Enqueued Resource ID: ac1808f0-d4d0-423f-abd5-9612116e67ac with Priority: HIGHEST for action security_group_rules [ 1203.037832] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ac1808f0-d4d0-423f-abd5-9612116e67ac with Priority: HIGHEST for action security_group_rules [ 1203.038023] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ac1808f0-d4d0-423f-abd5-9612116e67ac taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.038148] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ac1808f0-d4d0-423f-abd5-9612116e67ac" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.038218] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ac1808f0-d4d0-423f-abd5-9612116e67ac" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.038496] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ac1808f0-d4d0-423f-abd5-9612116e67ac" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.038578] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ac1808f0-d4d0-423f-abd5-9612116e67ac',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1203.139863] env[65306]: INFO networking_nsxv3.common.synchronization [None req-8c683f8f-d5a5-4023-92b6-a0cf7fa0b206 tempest-AttachVolumeNegativeTest-723798471 tempest-AttachVolumeNegativeTest-723798471-project-member] Enqueued Resource ID: ac1808f0-d4d0-423f-abd5-9612116e67ac with Priority: HIGHEST for action security_group_rules [ 1203.140257] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ac1808f0-d4d0-423f-abd5-9612116e67ac with Priority: HIGHEST for action security_group_rules [ 1203.140570] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ac1808f0-d4d0-423f-abd5-9612116e67ac taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.140718] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ac1808f0-d4d0-423f-abd5-9612116e67ac" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.559393] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.559552] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.559611] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.559816] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.559909] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.560016] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ac1808f0-d4d0-423f-abd5-9612116e67ac already deleted. [ 1203.560106] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ac1808f0-d4d0-423f-abd5-9612116e67ac" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.560260] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ac1808f0-d4d0-423f-abd5-9612116e67ac" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.560408] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ac1808f0-d4d0-423f-abd5-9612116e67ac" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.560492] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ac1808f0-d4d0-423f-abd5-9612116e67ac',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1204.089058] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.089058] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.089058] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.089058] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.089058] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.089058] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ac1808f0-d4d0-423f-abd5-9612116e67ac already deleted. [ 1204.089058] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ac1808f0-d4d0-423f-abd5-9612116e67ac" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.185829] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d82bad56-9830-4c7d-9763-6d8a05e0998c in Status: SUCCESS [ 1204.186122] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d82bad56-9830-4c7d-9763-6d8a05e0998c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.557503] env[65306]: INFO networking_nsxv3.common.synchronization [req-d9ba3371-3130-4661-8ad1-de9f6c5a4092 req-5e81f65b-78e1-40d5-87e3-e194f72b6b02 tempest-AttachInterfacesTestJSON-144464476 tempest-AttachInterfacesTestJSON-144464476-project-member] Enqueued Resource ID: a70508b0-bb5b-4d0d-af41-b80fbdcfe90e with Priority: HIGHEST for action security_group_members [ 1204.558506] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a70508b0-bb5b-4d0d-af41-b80fbdcfe90e with Priority: HIGHEST for action security_group_members [ 1204.558506] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-a70508b0-bb5b-4d0d-af41-b80fbdcfe90e taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.558616] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a70508b0-bb5b-4d0d-af41-b80fbdcfe90e" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.558616] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a70508b0-bb5b-4d0d-af41-b80fbdcfe90e" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.558861] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a70508b0-bb5b-4d0d-af41-b80fbdcfe90e" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.559050] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.559155] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.559220] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.559382] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.559465] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.559568] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a70508b0-bb5b-4d0d-af41-b80fbdcfe90e',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1204.774790] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6e403189-fcac-40e3-aa50-4c17f4d29895 in Status: SUCCESS [ 1204.774932] env[65306]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6e403189-fcac-40e3-aa50-4c17f4d29895 deletion is rescheduled due to dependency. [ 1204.774978] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6e403189-fcac-40e3-aa50-4c17f4d29895" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.886353] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock network-540 taken with stack trace [, , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.886551] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "network-540" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.886678] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "network-540" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.887580] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "network-540" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.887656] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.887791] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.887934] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.888432] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.888652] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.888927] env[65306]: DEBUG dogpile.cache.region [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] No value present for key: 'zone-id' {{(pid=65306) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1204.889081] env[65306]: DEBUG dogpile.lock [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] NeedRegenerationException {{(pid=65306) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1204.889200] env[65306]: DEBUG dogpile.lock [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] no value, waiting for create lock {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1204.889338] env[65306]: DEBUG dogpile.lock [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] value creation lock acquired {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1204.889466] env[65306]: DEBUG dogpile.cache.region [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] No value present for key: 'zone-id' {{(pid=65306) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1204.889574] env[65306]: DEBUG dogpile.lock [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Calling creation function for not-yet-present value {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1204.889714] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1204.909189] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1204.909373] env[65306]: DEBUG dogpile.cache.region [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65306) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1204.909515] env[65306]: DEBUG dogpile.lock [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Released creation lock {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1204.909716] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "network-540" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.910066] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock port-0ca63e53-1931-4159-9b63-86a99025f6b7 taken with stack trace [, , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.910246] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "port-0ca63e53-1931-4159-9b63-86a99025f6b7" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.910369] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "port-0ca63e53-1931-4159-9b63-86a99025f6b7" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.911032] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "port-0ca63e53-1931-4159-9b63-86a99025f6b7" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.911032] env[65306]: DEBUG networking_nsxv3.api.rpc [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0ca63e53-1931-4159-9b63-86a99025f6b7',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1205.061716] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.061948] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.062056] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.062295] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.062411] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.062629] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.062759] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.062843] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.063056] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.063196] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.063324] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a70508b0-bb5b-4d0d-af41-b80fbdcfe90e already deleted. [ 1205.063432] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a70508b0-bb5b-4d0d-af41-b80fbdcfe90e" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.413376] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.413865] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.413865] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.414172] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.414344] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.414480] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Segment Port 0ca63e53-1931-4159-9b63-86a99025f6b7 not found, creating... [ 1205.414797] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.414960] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.415092] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.415366] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.415519] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.415872] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.415966] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.416098] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.416325] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.416461] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.416600] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Resource: SegmentPort with ID: 0ca63e53-1931-4159-9b63-86a99025f6b7 is going to be created. [ 1205.441016] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.441265] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.441393] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.441655] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.441957] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.442209] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "port-0ca63e53-1931-4159-9b63-86a99025f6b7" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.137303] env[65306]: INFO networking_nsxv3.common.synchronization [req-d9ba3371-3130-4661-8ad1-de9f6c5a4092 req-41f63c89-cbb3-4dde-bc1d-b344a0b8e87d service nova] Enqueued Resource ID: a70508b0-bb5b-4d0d-af41-b80fbdcfe90e with Priority: HIGHEST for action security_group_rules [ 1206.137303] env[65306]: INFO networking_nsxv3.common.synchronization [req-d9ba3371-3130-4661-8ad1-de9f6c5a4092 req-41f63c89-cbb3-4dde-bc1d-b344a0b8e87d service nova] Enqueued Resource ID: a70508b0-bb5b-4d0d-af41-b80fbdcfe90e with Priority: HIGHEST for action security_group_members [ 1206.137303] env[65306]: INFO networking_nsxv3.common.synchronization [req-d9ba3371-3130-4661-8ad1-de9f6c5a4092 req-41f63c89-cbb3-4dde-bc1d-b344a0b8e87d service nova] Enqueued Resource ID: 0ca63e53-1931-4159-9b63-86a99025f6b7 with Priority: HIGHEST for action port [ 1206.137303] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a70508b0-bb5b-4d0d-af41-b80fbdcfe90e with Priority: HIGHEST for action security_group_rules [ 1206.137303] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a70508b0-bb5b-4d0d-af41-b80fbdcfe90e with Priority: HIGHEST for action security_group_members [ 1206.137727] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0ca63e53-1931-4159-9b63-86a99025f6b7 with Priority: HIGHEST for action port [ 1206.138246] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a70508b0-bb5b-4d0d-af41-b80fbdcfe90e taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.139605] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a70508b0-bb5b-4d0d-af41-b80fbdcfe90e" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.139605] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a70508b0-bb5b-4d0d-af41-b80fbdcfe90e" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.139605] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a70508b0-bb5b-4d0d-af41-b80fbdcfe90e" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.139605] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a70508b0-bb5b-4d0d-af41-b80fbdcfe90e',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1206.139996] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-a70508b0-bb5b-4d0d-af41-b80fbdcfe90e taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.140148] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a70508b0-bb5b-4d0d-af41-b80fbdcfe90e" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.140281] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a70508b0-bb5b-4d0d-af41-b80fbdcfe90e" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.140509] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a70508b0-bb5b-4d0d-af41-b80fbdcfe90e" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.140702] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.142484] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.142484] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.142484] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.142484] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.142696] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a70508b0-bb5b-4d0d-af41-b80fbdcfe90e',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1206.143333] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock port-0ca63e53-1931-4159-9b63-86a99025f6b7 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.143445] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0ca63e53-1931-4159-9b63-86a99025f6b7" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.143512] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0ca63e53-1931-4159-9b63-86a99025f6b7" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.143666] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0ca63e53-1931-4159-9b63-86a99025f6b7" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.143745] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0ca63e53-1931-4159-9b63-86a99025f6b7',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1206.645137] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-a70508b0-bb5b-4d0d-af41-b80fbdcfe90e taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.645498] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a70508b0-bb5b-4d0d-af41-b80fbdcfe90e" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.647689] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a70508b0-bb5b-4d0d-af41-b80fbdcfe90e',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1206.648991] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0ca63e53-1931-4159-9b63-86a99025f6b7 with status ACTIVE [ 1206.649239] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.649360] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.649425] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.649648] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.649753] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.649945] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.650056] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.650117] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.650284] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.650358] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.650551] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.650658] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.650750] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.650869] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.650945] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.651053] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0ca63e53-1931-4159-9b63-86a99025f6b7 is going to be updated. [ 1206.677898] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.678151] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.678151] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.678307] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.678456] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.678633] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0ca63e53-1931-4159-9b63-86a99025f6b7" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.153436] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a70508b0-bb5b-4d0d-af41-b80fbdcfe90e',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1207.446037] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock network-221 taken with stack trace [, , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.446204] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "network-221" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.446313] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "network-221" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.446584] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "network-221" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.446842] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.447011] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.447133] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.447348] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.447492] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.447699] env[65306]: DEBUG dogpile.cache.region [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] No value present for key: 'zone-id' {{(pid=65306) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1207.447811] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] NeedRegenerationException {{(pid=65306) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1207.447918] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] no value, waiting for create lock {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1207.448042] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] value creation lock acquired {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1207.448152] env[65306]: DEBUG dogpile.cache.region [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] No value present for key: 'zone-id' {{(pid=65306) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1207.448256] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Calling creation function for not-yet-present value {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1207.448385] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1207.468432] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1207.468551] env[65306]: DEBUG dogpile.cache.region [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65306) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1207.468699] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Released creation lock {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1207.468889] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "network-221" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.469231] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock port-0936ac13-cee3-42ed-834c-377791127339 taken with stack trace [, , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.469406] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "port-0936ac13-cee3-42ed-834c-377791127339" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.469528] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "port-0936ac13-cee3-42ed-834c-377791127339" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.469794] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "port-0936ac13-cee3-42ed-834c-377791127339" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.469935] env[65306]: DEBUG networking_nsxv3.api.rpc [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0936ac13-cee3-42ed-834c-377791127339',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1207.657039] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.657039] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.657039] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.657039] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.657039] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.657862] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a70508b0-bb5b-4d0d-af41-b80fbdcfe90e is going to be created. [ 1207.681187] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.681378] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.681421] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.681662] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.681829] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.691618] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a70508b0-bb5b-4d0d-af41-b80fbdcfe90e in Status: UNINITIALIZED for 2s [ 1207.973053] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.973478] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.973715] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.974166] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.974423] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.974981] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.975267] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.975478] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.975870] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.976080] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.976677] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.976840] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.977213] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.977555] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.977803] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.978058] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Resource: SegmentPort with ID: 0936ac13-cee3-42ed-834c-377791127339 is going to be updated. [ 1208.003079] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.003351] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.003811] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.003998] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.004369] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.004773] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "port-0936ac13-cee3-42ed-834c-377791127339" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.729800] env[65306]: INFO networking_nsxv3.common.synchronization [req-984d5ce0-2f29-4f25-a499-802af83126b4 req-ba2d867f-5b2e-4fae-bac9-a4f57ee483ad service nova] Enqueued Resource ID: 37349b8b-c2c1-4141-8b10-752c27492cbd with Priority: HIGHEST for action security_group_rules [ 1208.730223] env[65306]: INFO networking_nsxv3.common.synchronization [req-984d5ce0-2f29-4f25-a499-802af83126b4 req-ba2d867f-5b2e-4fae-bac9-a4f57ee483ad service nova] Enqueued Resource ID: 37349b8b-c2c1-4141-8b10-752c27492cbd with Priority: HIGHEST for action security_group_members [ 1208.730223] env[65306]: INFO networking_nsxv3.common.synchronization [req-984d5ce0-2f29-4f25-a499-802af83126b4 req-ba2d867f-5b2e-4fae-bac9-a4f57ee483ad service nova] Enqueued Resource ID: 0936ac13-cee3-42ed-834c-377791127339 with Priority: HIGHEST for action port [ 1208.730659] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 37349b8b-c2c1-4141-8b10-752c27492cbd with Priority: HIGHEST for action security_group_rules [ 1208.730803] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 37349b8b-c2c1-4141-8b10-752c27492cbd with Priority: HIGHEST for action security_group_members [ 1208.730898] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0936ac13-cee3-42ed-834c-377791127339 with Priority: HIGHEST for action port [ 1208.731198] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock rules-37349b8b-c2c1-4141-8b10-752c27492cbd taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.731328] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-37349b8b-c2c1-4141-8b10-752c27492cbd" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.731437] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-37349b8b-c2c1-4141-8b10-752c27492cbd" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.731601] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-37349b8b-c2c1-4141-8b10-752c27492cbd" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.731692] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('37349b8b-c2c1-4141-8b10-752c27492cbd',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1208.732598] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-37349b8b-c2c1-4141-8b10-752c27492cbd taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.732721] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-37349b8b-c2c1-4141-8b10-752c27492cbd" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.732788] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-37349b8b-c2c1-4141-8b10-752c27492cbd" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.732962] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-37349b8b-c2c1-4141-8b10-752c27492cbd" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.733128] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.733224] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.733279] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.733412] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.733495] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.733584] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('37349b8b-c2c1-4141-8b10-752c27492cbd',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1208.734357] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock port-0936ac13-cee3-42ed-834c-377791127339 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.734466] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0936ac13-cee3-42ed-834c-377791127339" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.734531] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0936ac13-cee3-42ed-834c-377791127339" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.734708] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0936ac13-cee3-42ed-834c-377791127339" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.734995] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0936ac13-cee3-42ed-834c-377791127339',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1209.237077] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-37349b8b-c2c1-4141-8b10-752c27492cbd taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.237227] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-37349b8b-c2c1-4141-8b10-752c27492cbd" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.237414] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('37349b8b-c2c1-4141-8b10-752c27492cbd',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1209.238313] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0936ac13-cee3-42ed-834c-377791127339 with status ACTIVE [ 1209.238511] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.238624] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.238692] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.238888] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.238992] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.239180] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.239278] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.239341] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.239496] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.240713] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.240713] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.240713] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.240713] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.240713] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.240713] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.240713] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0936ac13-cee3-42ed-834c-377791127339 is going to be updated. [ 1209.263050] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.263196] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.263240] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.263468] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.263640] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.263841] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0936ac13-cee3-42ed-834c-377791127339" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.701527] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a70508b0-bb5b-4d0d-af41-b80fbdcfe90e in Status: SUCCESS [ 1209.701763] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a70508b0-bb5b-4d0d-af41-b80fbdcfe90e" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.701931] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a70508b0-bb5b-4d0d-af41-b80fbdcfe90e" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.702175] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a70508b0-bb5b-4d0d-af41-b80fbdcfe90e" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.702372] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.702492] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.702577] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.702710] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.702792] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.702879] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a70508b0-bb5b-4d0d-af41-b80fbdcfe90e" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.702968] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a70508b0-bb5b-4d0d-af41-b80fbdcfe90e',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1209.742533] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('37349b8b-c2c1-4141-8b10-752c27492cbd',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1210.170506] env[65306]: INFO networking_nsxv3.common.synchronization [req-93d69958-3409-4974-8b6d-4c63f530a261 req-489dfb9d-7250-42cd-9400-259a3aea37f3 tempest-AttachVolumeNegativeTest-723798471 tempest-AttachVolumeNegativeTest-723798471-project-member] Enqueued Resource ID: ac1808f0-d4d0-423f-abd5-9612116e67ac with Priority: HIGHEST for action security_group_members [ 1210.170506] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ac1808f0-d4d0-423f-abd5-9612116e67ac with Priority: HIGHEST for action security_group_members [ 1210.170797] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-ac1808f0-d4d0-423f-abd5-9612116e67ac taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.170923] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ac1808f0-d4d0-423f-abd5-9612116e67ac" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.170994] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ac1808f0-d4d0-423f-abd5-9612116e67ac" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.171354] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ac1808f0-d4d0-423f-abd5-9612116e67ac" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.171521] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.171618] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.171683] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.171842] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.171952] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.172056] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ac1808f0-d4d0-423f-abd5-9612116e67ac',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1210.204860] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a70508b0-bb5b-4d0d-af41-b80fbdcfe90e',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1210.245380] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.245523] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.245836] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.246163] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.246281] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.246417] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 37349b8b-c2c1-4141-8b10-752c27492cbd is going to be updated. [ 1210.281152] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.281471] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.281560] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.281902] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.282181] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.295698] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 37349b8b-c2c1-4141-8b10-752c27492cbd in Status: IN_PROGRESS for 2s [ 1210.558522] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock network-638 taken with stack trace [, , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.558771] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "network-638" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.559020] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "network-638" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.559324] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "network-638" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.559615] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.559823] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.559930] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.560180] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.560343] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.560554] env[65306]: DEBUG dogpile.cache.region [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] No value present for key: 'zone-id' {{(pid=65306) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1210.560795] env[65306]: DEBUG dogpile.lock [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] NeedRegenerationException {{(pid=65306) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1210.560795] env[65306]: DEBUG dogpile.lock [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] no value, waiting for create lock {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1210.560907] env[65306]: DEBUG dogpile.lock [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] value creation lock acquired {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1210.560992] env[65306]: DEBUG dogpile.cache.region [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] No value present for key: 'zone-id' {{(pid=65306) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1210.561116] env[65306]: DEBUG dogpile.lock [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Calling creation function for not-yet-present value {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1210.561235] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1210.581830] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1210.582014] env[65306]: DEBUG dogpile.cache.region [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65306) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1210.582165] env[65306]: DEBUG dogpile.lock [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Released creation lock {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1210.582341] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "network-638" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.582699] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock port-66f99e04-fd3c-4edd-bd1a-dcdc20e02b0e taken with stack trace [, , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.582818] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "port-66f99e04-fd3c-4edd-bd1a-dcdc20e02b0e" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.583080] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "port-66f99e04-fd3c-4edd-bd1a-dcdc20e02b0e" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.583299] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "port-66f99e04-fd3c-4edd-bd1a-dcdc20e02b0e" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.583436] env[65306]: DEBUG networking_nsxv3.api.rpc [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('66f99e04-fd3c-4edd-bd1a-dcdc20e02b0e',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1210.674463] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.674582] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.674651] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.674896] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.675049] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.675285] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.675392] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.675525] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.675641] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.675847] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.675916] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ac1808f0-d4d0-423f-abd5-9612116e67ac already deleted. [ 1210.675972] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ac1808f0-d4d0-423f-abd5-9612116e67ac" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.707891] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a70508b0-bb5b-4d0d-af41-b80fbdcfe90e: rpc.has_security_group_logging(os_id): False [ 1210.732462] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.732624] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.732699] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.732884] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.732974] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.733240] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.733344] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.733403] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.733562] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.733645] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.733736] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a70508b0-bb5b-4d0d-af41-b80fbdcfe90e is going to be created. [ 1210.820814] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.821265] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.821265] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.821345] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.821490] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.838760] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a70508b0-bb5b-4d0d-af41-b80fbdcfe90e in Status: IN_PROGRESS for 2s [ 1211.089219] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.089219] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.089219] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1211.089219] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.089219] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1211.089219] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Segment Port 66f99e04-fd3c-4edd-bd1a-dcdc20e02b0e not found, creating... [ 1211.089219] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.089219] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.089219] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1211.089219] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.089219] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1211.089581] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.089581] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.089800] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1211.090149] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.091961] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1211.091961] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Resource: SegmentPort with ID: 66f99e04-fd3c-4edd-bd1a-dcdc20e02b0e is going to be created. [ 1211.111610] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.111878] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.112096] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1211.112426] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.112795] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1211.113161] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "port-66f99e04-fd3c-4edd-bd1a-dcdc20e02b0e" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1211.827791] env[65306]: INFO networking_nsxv3.common.synchronization [req-93d69958-3409-4974-8b6d-4c63f530a261 req-d4f1ef04-31fa-48fa-8485-bdd656f0557e service nova] Enqueued Resource ID: ac1808f0-d4d0-423f-abd5-9612116e67ac with Priority: HIGHEST for action security_group_rules [ 1211.828068] env[65306]: INFO networking_nsxv3.common.synchronization [req-93d69958-3409-4974-8b6d-4c63f530a261 req-d4f1ef04-31fa-48fa-8485-bdd656f0557e service nova] Enqueued Resource ID: ac1808f0-d4d0-423f-abd5-9612116e67ac with Priority: HIGHEST for action security_group_members [ 1211.828182] env[65306]: INFO networking_nsxv3.common.synchronization [req-93d69958-3409-4974-8b6d-4c63f530a261 req-d4f1ef04-31fa-48fa-8485-bdd656f0557e service nova] Enqueued Resource ID: 66f99e04-fd3c-4edd-bd1a-dcdc20e02b0e with Priority: HIGHEST for action port [ 1211.828759] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ac1808f0-d4d0-423f-abd5-9612116e67ac with Priority: HIGHEST for action security_group_rules [ 1211.828918] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ac1808f0-d4d0-423f-abd5-9612116e67ac with Priority: HIGHEST for action security_group_members [ 1211.829119] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 66f99e04-fd3c-4edd-bd1a-dcdc20e02b0e with Priority: HIGHEST for action port [ 1211.829393] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ac1808f0-d4d0-423f-abd5-9612116e67ac taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.829524] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ac1808f0-d4d0-423f-abd5-9612116e67ac" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.829607] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ac1808f0-d4d0-423f-abd5-9612116e67ac" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1211.829827] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ac1808f0-d4d0-423f-abd5-9612116e67ac" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.829937] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ac1808f0-d4d0-423f-abd5-9612116e67ac',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1211.830831] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-ac1808f0-d4d0-423f-abd5-9612116e67ac taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.830947] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ac1808f0-d4d0-423f-abd5-9612116e67ac" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.831109] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ac1808f0-d4d0-423f-abd5-9612116e67ac" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1211.831408] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ac1808f0-d4d0-423f-abd5-9612116e67ac" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.831447] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.831549] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.831611] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1211.832463] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.832591] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1211.832783] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ac1808f0-d4d0-423f-abd5-9612116e67ac',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1211.834249] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock port-66f99e04-fd3c-4edd-bd1a-dcdc20e02b0e taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.834364] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-66f99e04-fd3c-4edd-bd1a-dcdc20e02b0e" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.834435] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-66f99e04-fd3c-4edd-bd1a-dcdc20e02b0e" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1211.834603] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-66f99e04-fd3c-4edd-bd1a-dcdc20e02b0e" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.834702] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('66f99e04-fd3c-4edd-bd1a-dcdc20e02b0e',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1212.307652] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 37349b8b-c2c1-4141-8b10-752c27492cbd in Status: SUCCESS [ 1212.307897] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-37349b8b-c2c1-4141-8b10-752c27492cbd" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.308081] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-37349b8b-c2c1-4141-8b10-752c27492cbd" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.308326] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-37349b8b-c2c1-4141-8b10-752c27492cbd" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.308528] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.308644] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.308707] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.308880] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.308964] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.309076] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-37349b8b-c2c1-4141-8b10-752c27492cbd" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.309173] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('37349b8b-c2c1-4141-8b10-752c27492cbd',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1212.336295] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-ac1808f0-d4d0-423f-abd5-9612116e67ac taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.336496] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ac1808f0-d4d0-423f-abd5-9612116e67ac" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.336626] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ac1808f0-d4d0-423f-abd5-9612116e67ac',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1212.337617] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 66f99e04-fd3c-4edd-bd1a-dcdc20e02b0e with status ACTIVE [ 1212.337925] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.337925] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.338183] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.338306] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.338306] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.338518] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.338583] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.338649] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.338803] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.338881] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.339399] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.339399] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.339399] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.339399] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.339542] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.339542] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 66f99e04-fd3c-4edd-bd1a-dcdc20e02b0e is going to be updated. [ 1212.362248] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.362494] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.362645] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.362906] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.363166] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.363437] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-66f99e04-fd3c-4edd-bd1a-dcdc20e02b0e" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.543451] env[65306]: INFO networking_nsxv3.common.synchronization [req-27f54c82-355d-4c47-8d9b-23fad6733906 req-baadae3f-ee45-49d5-889e-57ed6487a4d5 tempest-ServerActionsTestOtherA-65612913 tempest-ServerActionsTestOtherA-65612913-project-member] Enqueued Resource ID: 2536346e-d62c-4c9f-a652-a4136cc7ff65 with Priority: HIGHEST for action security_group_members [ 1212.543995] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2536346e-d62c-4c9f-a652-a4136cc7ff65 with Priority: HIGHEST for action security_group_members [ 1212.544317] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-2536346e-d62c-4c9f-a652-a4136cc7ff65 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.544445] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2536346e-d62c-4c9f-a652-a4136cc7ff65" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.544513] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2536346e-d62c-4c9f-a652-a4136cc7ff65" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.544888] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2536346e-d62c-4c9f-a652-a4136cc7ff65" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.544997] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.545065] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.545125] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.545279] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.545366] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.545460] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2536346e-d62c-4c9f-a652-a4136cc7ff65',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1212.811665] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('37349b8b-c2c1-4141-8b10-752c27492cbd',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1212.842406] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ac1808f0-d4d0-423f-abd5-9612116e67ac',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1212.852623] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a70508b0-bb5b-4d0d-af41-b80fbdcfe90e in Status: SUCCESS [ 1212.852866] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a70508b0-bb5b-4d0d-af41-b80fbdcfe90e" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.884411] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock network-435 taken with stack trace [, , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.884411] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "network-435" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.884737] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "network-435" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.884915] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "network-435" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.885295] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.885295] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.886134] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.886134] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.886134] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.886134] env[65306]: DEBUG dogpile.cache.region [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] No value present for key: 'zone-id' {{(pid=65306) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1212.886134] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] NeedRegenerationException {{(pid=65306) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1212.886423] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] no value, waiting for create lock {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1212.886423] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] value creation lock acquired {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1212.886423] env[65306]: DEBUG dogpile.cache.region [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] No value present for key: 'zone-id' {{(pid=65306) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1212.886522] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Calling creation function for not-yet-present value {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1212.886631] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1212.905015] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1212.905234] env[65306]: DEBUG dogpile.cache.region [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=65306) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1212.905400] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Released creation lock {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1212.905611] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "network-435" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.906082] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock port-60b3bf61-d05d-4556-bfc5-91a423b073a9 taken with stack trace [, , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.906279] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "port-60b3bf61-d05d-4556-bfc5-91a423b073a9" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.906418] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "port-60b3bf61-d05d-4556-bfc5-91a423b073a9" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.906748] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "port-60b3bf61-d05d-4556-bfc5-91a423b073a9" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.906906] env[65306]: DEBUG networking_nsxv3.api.rpc [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('60b3bf61-d05d-4556-bfc5-91a423b073a9',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1213.047822] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1213.048056] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1213.048136] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1213.048345] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1213.048444] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1213.048710] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1213.048823] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1213.048916] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1213.049073] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1213.049158] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1213.049247] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2536346e-d62c-4c9f-a652-a4136cc7ff65 already deleted. [ 1213.049332] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2536346e-d62c-4c9f-a652-a4136cc7ff65" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1213.315696] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 37349b8b-c2c1-4141-8b10-752c27492cbd: rpc.has_security_group_logging(os_id): False [ 1213.337304] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1213.337304] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1213.337304] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1213.337304] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1213.337304] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1213.337304] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1213.337304] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1213.337304] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1213.337304] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1213.337304] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1213.337304] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 37349b8b-c2c1-4141-8b10-752c27492cbd is going to be updated. [ 1213.345036] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1213.345036] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1213.345036] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1213.345036] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1213.345036] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1213.345390] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ac1808f0-d4d0-423f-abd5-9612116e67ac is going to be created. [ 1213.373714] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1213.373920] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1213.374050] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1213.374403] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1213.374679] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1213.386669] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ac1808f0-d4d0-423f-abd5-9612116e67ac in Status: UNINITIALIZED for 2s [ 1213.409760] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1213.410102] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1213.410246] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1213.410537] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1213.410718] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1213.410908] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Segment Port 60b3bf61-d05d-4556-bfc5-91a423b073a9 not found, creating... [ 1213.411252] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1213.411470] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1213.411627] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1213.411909] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1213.412114] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1213.412524] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1213.412737] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1213.412896] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1213.413154] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1213.413315] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1213.413473] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Resource: SegmentPort with ID: 60b3bf61-d05d-4556-bfc5-91a423b073a9 is going to be created. [ 1213.416208] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1213.416336] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1213.416423] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1213.416559] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1213.416723] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1213.433408] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 37349b8b-c2c1-4141-8b10-752c27492cbd in Status: IN_PROGRESS for 2s [ 1213.439715] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1213.439928] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1213.440224] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1213.440422] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1213.440532] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1213.440760] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "port-60b3bf61-d05d-4556-bfc5-91a423b073a9" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.210654] env[65306]: INFO networking_nsxv3.common.synchronization [req-27f54c82-355d-4c47-8d9b-23fad6733906 req-860c8b28-98ac-4142-b7a7-2baa8b3cb4ef service nova] Enqueued Resource ID: 2536346e-d62c-4c9f-a652-a4136cc7ff65 with Priority: HIGHEST for action security_group_rules [ 1214.210958] env[65306]: INFO networking_nsxv3.common.synchronization [req-27f54c82-355d-4c47-8d9b-23fad6733906 req-860c8b28-98ac-4142-b7a7-2baa8b3cb4ef service nova] Enqueued Resource ID: 2536346e-d62c-4c9f-a652-a4136cc7ff65 with Priority: HIGHEST for action security_group_members [ 1214.211026] env[65306]: INFO networking_nsxv3.common.synchronization [req-27f54c82-355d-4c47-8d9b-23fad6733906 req-860c8b28-98ac-4142-b7a7-2baa8b3cb4ef service nova] Enqueued Resource ID: 60b3bf61-d05d-4556-bfc5-91a423b073a9 with Priority: HIGHEST for action port [ 1214.211537] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2536346e-d62c-4c9f-a652-a4136cc7ff65 with Priority: HIGHEST for action security_group_rules [ 1214.211708] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2536346e-d62c-4c9f-a652-a4136cc7ff65 with Priority: HIGHEST for action security_group_members [ 1214.211812] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 60b3bf61-d05d-4556-bfc5-91a423b073a9 with Priority: HIGHEST for action port [ 1214.212111] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2536346e-d62c-4c9f-a652-a4136cc7ff65 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.212237] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2536346e-d62c-4c9f-a652-a4136cc7ff65" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.212303] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2536346e-d62c-4c9f-a652-a4136cc7ff65" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.212566] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2536346e-d62c-4c9f-a652-a4136cc7ff65" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.212668] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2536346e-d62c-4c9f-a652-a4136cc7ff65',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1214.213597] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-2536346e-d62c-4c9f-a652-a4136cc7ff65 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.213717] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2536346e-d62c-4c9f-a652-a4136cc7ff65" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.213786] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2536346e-d62c-4c9f-a652-a4136cc7ff65" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.213972] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2536346e-d62c-4c9f-a652-a4136cc7ff65" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.214161] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.214305] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.214396] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.214571] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.214695] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.214827] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2536346e-d62c-4c9f-a652-a4136cc7ff65',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1214.216556] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock port-60b3bf61-d05d-4556-bfc5-91a423b073a9 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.216556] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-60b3bf61-d05d-4556-bfc5-91a423b073a9" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.216556] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-60b3bf61-d05d-4556-bfc5-91a423b073a9" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.216556] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-60b3bf61-d05d-4556-bfc5-91a423b073a9" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.216556] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('60b3bf61-d05d-4556-bfc5-91a423b073a9',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1214.718189] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-2536346e-d62c-4c9f-a652-a4136cc7ff65 taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.718367] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2536346e-d62c-4c9f-a652-a4136cc7ff65" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.718523] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2536346e-d62c-4c9f-a652-a4136cc7ff65',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1214.719495] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 60b3bf61-d05d-4556-bfc5-91a423b073a9 with status ACTIVE [ 1214.719673] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.719796] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.719870] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.720108] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.720198] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.720373] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.720470] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.720540] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.720714] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.720789] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.720969] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.721072] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.721130] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.721267] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.722049] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.722049] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 60b3bf61-d05d-4556-bfc5-91a423b073a9 is going to be updated. [ 1214.743893] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.744119] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.744175] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.744390] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.744481] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.744650] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-60b3bf61-d05d-4556-bfc5-91a423b073a9" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.768506] env[65306]: INFO networking_nsxv3.common.synchronization [req-c6bdfb11-4343-48ea-a433-bdfc3ca207b6 req-219fe1db-ce8f-4396-8e75-d2ca7fb133d4 tempest-AttachVolumeTestJSON-1277615836 tempest-AttachVolumeTestJSON-1277615836-project-member] Enqueued Resource ID: 1b97992b-9002-4b6e-b809-d68f93354c99 with Priority: HIGHEST for action security_group_members [ 1214.768506] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1b97992b-9002-4b6e-b809-d68f93354c99 with Priority: HIGHEST for action security_group_members [ 1214.768506] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-1b97992b-9002-4b6e-b809-d68f93354c99 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.768506] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1b97992b-9002-4b6e-b809-d68f93354c99" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.768506] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1b97992b-9002-4b6e-b809-d68f93354c99" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.768506] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1b97992b-9002-4b6e-b809-d68f93354c99" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.768506] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.768506] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.769032] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.769587] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.769647] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.769760] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1b97992b-9002-4b6e-b809-d68f93354c99',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1215.224125] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2536346e-d62c-4c9f-a652-a4136cc7ff65',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1215.272688] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.272688] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.272688] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.272922] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.273018] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.273199] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.273332] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.273506] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.273506] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.273726] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.273726] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1b97992b-9002-4b6e-b809-d68f93354c99 is going to be updated. [ 1215.310444] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.310444] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.310444] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.310444] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.310444] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.323696] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1b97992b-9002-4b6e-b809-d68f93354c99 in Status: IN_PROGRESS for 2s [ 1215.402072] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ac1808f0-d4d0-423f-abd5-9612116e67ac in Status: SUCCESS [ 1215.402072] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ac1808f0-d4d0-423f-abd5-9612116e67ac" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.402282] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ac1808f0-d4d0-423f-abd5-9612116e67ac" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.402704] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ac1808f0-d4d0-423f-abd5-9612116e67ac" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.402704] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.402900] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.402900] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.403088] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.403169] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.403253] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ac1808f0-d4d0-423f-abd5-9612116e67ac" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.403358] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ac1808f0-d4d0-423f-abd5-9612116e67ac',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1215.450496] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 37349b8b-c2c1-4141-8b10-752c27492cbd in Status: SUCCESS [ 1215.450725] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-37349b8b-c2c1-4141-8b10-752c27492cbd" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.726734] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.726903] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.727013] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.727264] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.727366] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.727492] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2536346e-d62c-4c9f-a652-a4136cc7ff65 is going to be created. [ 1215.772746] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.772888] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.772942] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.773191] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.773361] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.793416] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2536346e-d62c-4c9f-a652-a4136cc7ff65 in Status: UNINITIALIZED for 2s [ 1215.905603] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ac1808f0-d4d0-423f-abd5-9612116e67ac',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1216.411059] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ac1808f0-d4d0-423f-abd5-9612116e67ac: rpc.has_security_group_logging(os_id): False [ 1216.447935] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.448195] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.448266] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.448552] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.448673] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.448905] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.449096] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.449155] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.449408] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.449547] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.449694] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ac1808f0-d4d0-423f-abd5-9612116e67ac is going to be created. [ 1216.532413] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.532594] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.532658] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.532815] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.532996] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.551538] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ac1808f0-d4d0-423f-abd5-9612116e67ac in Status: IN_PROGRESS for 2s [ 1217.336554] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1b97992b-9002-4b6e-b809-d68f93354c99 in Status: SUCCESS [ 1217.336734] env[65306]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1b97992b-9002-4b6e-b809-d68f93354c99 deletion is rescheduled due to dependency. [ 1217.336802] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1b97992b-9002-4b6e-b809-d68f93354c99" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.810118] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2536346e-d62c-4c9f-a652-a4136cc7ff65 in Status: SUCCESS [ 1217.810689] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2536346e-d62c-4c9f-a652-a4136cc7ff65" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.810689] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2536346e-d62c-4c9f-a652-a4136cc7ff65" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.810889] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2536346e-d62c-4c9f-a652-a4136cc7ff65" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.811158] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.811299] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.811368] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.811544] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.811672] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.811771] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2536346e-d62c-4c9f-a652-a4136cc7ff65" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.811820] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2536346e-d62c-4c9f-a652-a4136cc7ff65',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1218.314640] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-2536346e-d62c-4c9f-a652-a4136cc7ff65 taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.314904] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2536346e-d62c-4c9f-a652-a4136cc7ff65" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.315018] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2536346e-d62c-4c9f-a652-a4136cc7ff65" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.315294] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2536346e-d62c-4c9f-a652-a4136cc7ff65" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.315907] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.316040] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.316104] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.316317] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.316414] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.316506] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2536346e-d62c-4c9f-a652-a4136cc7ff65" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.316666] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-2536346e-d62c-4c9f-a652-a4136cc7ff65 taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.316763] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2536346e-d62c-4c9f-a652-a4136cc7ff65" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.316817] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2536346e-d62c-4c9f-a652-a4136cc7ff65" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.317025] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2536346e-d62c-4c9f-a652-a4136cc7ff65" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.317228] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.317346] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.317414] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.317577] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.317678] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.317767] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2536346e-d62c-4c9f-a652-a4136cc7ff65" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.317884] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2536346e-d62c-4c9f-a652-a4136cc7ff65',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1218.566517] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ac1808f0-d4d0-423f-abd5-9612116e67ac in Status: SUCCESS [ 1218.566744] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ac1808f0-d4d0-423f-abd5-9612116e67ac" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.821054] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2536346e-d62c-4c9f-a652-a4136cc7ff65: rpc.has_security_group_logging(os_id): False [ 1218.840251] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.840499] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.840619] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.840917] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.841086] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.841336] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.841458] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.841540] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.841671] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.841751] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.841951] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.842059] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.842117] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.842263] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.842373] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.842554] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.842685] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.842685] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.842849] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.842909] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.843022] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2536346e-d62c-4c9f-a652-a4136cc7ff65 is going to be created. [ 1218.901847] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.902040] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.902109] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.902374] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.902602] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.914516] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2536346e-d62c-4c9f-a652-a4136cc7ff65 in Status: IN_PROGRESS for 2s [ 1219.768765] env[65306]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1219.768988] env[65306]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1220.143597] env[65306]: INFO networking_nsxv3.common.synchronization [req-2959741c-9b9c-420b-83e5-34c3ac260177 req-8b23772b-fd57-419f-8388-c88711c3be6d tempest-ServerActionsTestJSON-437813836 tempest-ServerActionsTestJSON-437813836-project-member] Enqueued Resource ID: 6e403189-fcac-40e3-aa50-4c17f4d29895 with Priority: HIGHEST for action security_group_members [ 1220.144475] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6e403189-fcac-40e3-aa50-4c17f4d29895 with Priority: HIGHEST for action security_group_members [ 1220.144860] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-6e403189-fcac-40e3-aa50-4c17f4d29895 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.145024] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6e403189-fcac-40e3-aa50-4c17f4d29895" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.145142] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6e403189-fcac-40e3-aa50-4c17f4d29895" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.145425] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6e403189-fcac-40e3-aa50-4c17f4d29895" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.145604] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.145724] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.145805] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.146025] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.146142] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.146249] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6e403189-fcac-40e3-aa50-4c17f4d29895',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1220.528487] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock network-910 taken with stack trace [, , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.530021] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "network-910" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.530021] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "network-910" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.530021] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "network-910" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.530021] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.530021] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.530503] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.530905] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.531284] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.531684] env[65306]: DEBUG dogpile.cache.region [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] No value present for key: 'zone-id' {{(pid=65306) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1220.531960] env[65306]: DEBUG dogpile.lock [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] NeedRegenerationException {{(pid=65306) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1220.532210] env[65306]: DEBUG dogpile.lock [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] no value, waiting for create lock {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1220.533024] env[65306]: DEBUG dogpile.lock [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] value creation lock acquired {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1220.533024] env[65306]: DEBUG dogpile.cache.region [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] No value present for key: 'zone-id' {{(pid=65306) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1220.533024] env[65306]: DEBUG dogpile.lock [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Calling creation function for not-yet-present value {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1220.533024] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1220.557616] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1220.557825] env[65306]: DEBUG dogpile.cache.region [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=65306) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1220.557992] env[65306]: DEBUG dogpile.lock [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Released creation lock {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1220.558197] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "network-910" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.558628] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock port-6261fa48-5ef5-446e-814c-c00004064fd4 taken with stack trace [, , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.558850] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "port-6261fa48-5ef5-446e-814c-c00004064fd4" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.558983] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "port-6261fa48-5ef5-446e-814c-c00004064fd4" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.559461] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "port-6261fa48-5ef5-446e-814c-c00004064fd4" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.559698] env[65306]: DEBUG networking_nsxv3.api.rpc [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6261fa48-5ef5-446e-814c-c00004064fd4',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1220.649152] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.649414] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.649534] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.649847] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.649999] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.650325] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.650491] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.650602] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.650851] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.650989] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.651153] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6e403189-fcac-40e3-aa50-4c17f4d29895 is going to be updated. [ 1220.680678] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.680887] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.681186] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.681438] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.681593] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.694422] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6e403189-fcac-40e3-aa50-4c17f4d29895 in Status: IN_PROGRESS for 2s [ 1220.935424] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2536346e-d62c-4c9f-a652-a4136cc7ff65 in Status: SUCCESS [ 1220.935925] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2536346e-d62c-4c9f-a652-a4136cc7ff65" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.063286] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.063531] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.063645] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.063953] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.064166] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.064347] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Segment Port 6261fa48-5ef5-446e-814c-c00004064fd4 not found, creating... [ 1221.064628] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.064795] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.064957] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.065223] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.065374] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.065776] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.066021] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.066155] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.066743] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.066743] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.066743] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Resource: SegmentPort with ID: 6261fa48-5ef5-446e-814c-c00004064fd4 is going to be created. [ 1221.100794] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.101020] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.101433] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.101872] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.102159] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.102425] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "port-6261fa48-5ef5-446e-814c-c00004064fd4" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.836741] env[65306]: INFO networking_nsxv3.common.synchronization [req-2959741c-9b9c-420b-83e5-34c3ac260177 req-8224d67b-f875-4780-8e10-d0d70df1cbf7 service nova] Enqueued Resource ID: 6e403189-fcac-40e3-aa50-4c17f4d29895 with Priority: HIGHEST for action security_group_rules [ 1221.837063] env[65306]: INFO networking_nsxv3.common.synchronization [req-2959741c-9b9c-420b-83e5-34c3ac260177 req-8224d67b-f875-4780-8e10-d0d70df1cbf7 service nova] Enqueued Resource ID: 6e403189-fcac-40e3-aa50-4c17f4d29895 with Priority: HIGHEST for action security_group_members [ 1221.837342] env[65306]: INFO networking_nsxv3.common.synchronization [req-2959741c-9b9c-420b-83e5-34c3ac260177 req-8224d67b-f875-4780-8e10-d0d70df1cbf7 service nova] Enqueued Resource ID: 6261fa48-5ef5-446e-814c-c00004064fd4 with Priority: HIGHEST for action port [ 1221.838092] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6e403189-fcac-40e3-aa50-4c17f4d29895 with Priority: HIGHEST for action security_group_rules [ 1221.838312] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6e403189-fcac-40e3-aa50-4c17f4d29895 with Priority: HIGHEST for action security_group_members [ 1221.838542] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6261fa48-5ef5-446e-814c-c00004064fd4 with Priority: HIGHEST for action port [ 1221.838966] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6e403189-fcac-40e3-aa50-4c17f4d29895 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.839197] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6e403189-fcac-40e3-aa50-4c17f4d29895" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.839297] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6e403189-fcac-40e3-aa50-4c17f4d29895" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.839665] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6e403189-fcac-40e3-aa50-4c17f4d29895" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.839741] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6e403189-fcac-40e3-aa50-4c17f4d29895',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1221.840942] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-6e403189-fcac-40e3-aa50-4c17f4d29895 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.841132] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6e403189-fcac-40e3-aa50-4c17f4d29895" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.841354] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock port-6261fa48-5ef5-446e-814c-c00004064fd4 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.841577] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6261fa48-5ef5-446e-814c-c00004064fd4" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.841646] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6261fa48-5ef5-446e-814c-c00004064fd4" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.841869] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6261fa48-5ef5-446e-814c-c00004064fd4" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.842079] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6261fa48-5ef5-446e-814c-c00004064fd4',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1222.345051] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-6e403189-fcac-40e3-aa50-4c17f4d29895 taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.345051] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6e403189-fcac-40e3-aa50-4c17f4d29895" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1222.345265] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6261fa48-5ef5-446e-814c-c00004064fd4 with status ACTIVE [ 1222.345425] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.345543] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1222.345637] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1222.345942] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1222.346130] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1222.346373] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.346483] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1222.346591] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1222.346821] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1222.346919] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1222.347228] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.347360] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1222.347511] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1222.347686] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1222.347830] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1222.347929] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6261fa48-5ef5-446e-814c-c00004064fd4 is going to be updated. [ 1222.375074] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.375074] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1222.375074] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1222.375418] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1222.375418] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1222.375583] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6261fa48-5ef5-446e-814c-c00004064fd4" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1222.704866] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6e403189-fcac-40e3-aa50-4c17f4d29895 in Status: SUCCESS [ 1222.705191] env[65306]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6e403189-fcac-40e3-aa50-4c17f4d29895 deletion is rescheduled due to dependency. [ 1222.705311] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6e403189-fcac-40e3-aa50-4c17f4d29895" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1222.705620] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6e403189-fcac-40e3-aa50-4c17f4d29895" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1222.705778] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6e403189-fcac-40e3-aa50-4c17f4d29895" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1222.706016] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.706176] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1222.706256] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1222.706476] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1222.706598] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1222.706706] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6e403189-fcac-40e3-aa50-4c17f4d29895',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1223.209316] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6e403189-fcac-40e3-aa50-4c17f4d29895',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1223.712396] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6e403189-fcac-40e3-aa50-4c17f4d29895',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1224.215336] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1224.215336] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1224.215336] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1224.215336] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1224.215336] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1224.215861] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6e403189-fcac-40e3-aa50-4c17f4d29895 is going to be updated. [ 1224.246807] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1224.246966] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1224.247043] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1224.247484] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1224.247661] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1224.261764] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6e403189-fcac-40e3-aa50-4c17f4d29895 in Status: IN_PROGRESS for 2s [ 1224.304967] env[65306]: INFO networking_nsxv3.common.synchronization [req-87d84eaa-c004-469a-9167-f7e9f30ff277 req-1c1ce971-2105-42de-bce9-12dc82af264a tempest-AttachInterfacesTestJSON-144464476 tempest-AttachInterfacesTestJSON-144464476-project-member] Enqueued Resource ID: a70508b0-bb5b-4d0d-af41-b80fbdcfe90e with Priority: HIGHEST for action security_group_members [ 1224.305663] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a70508b0-bb5b-4d0d-af41-b80fbdcfe90e with Priority: HIGHEST for action security_group_members [ 1224.306247] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-a70508b0-bb5b-4d0d-af41-b80fbdcfe90e taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1224.306401] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a70508b0-bb5b-4d0d-af41-b80fbdcfe90e" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1224.306512] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a70508b0-bb5b-4d0d-af41-b80fbdcfe90e" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1224.306772] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a70508b0-bb5b-4d0d-af41-b80fbdcfe90e" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1224.306975] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1224.307137] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1224.307314] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1224.307467] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1224.307573] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1224.307687] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a70508b0-bb5b-4d0d-af41-b80fbdcfe90e',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1224.692110] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock network-540 taken with stack trace [, , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1224.692316] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "network-540" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1224.692455] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "network-540" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1224.692791] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "network-540" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1224.693092] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1224.693283] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1224.693408] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1224.693643] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1224.693793] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1224.694011] env[65306]: DEBUG dogpile.cache.region [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] No value present for key: 'zone-id' {{(pid=65306) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1224.694132] env[65306]: DEBUG dogpile.lock [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] NeedRegenerationException {{(pid=65306) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1224.694240] env[65306]: DEBUG dogpile.lock [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] no value, waiting for create lock {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1224.694348] env[65306]: DEBUG dogpile.lock [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] value creation lock acquired {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1224.694457] env[65306]: DEBUG dogpile.cache.region [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] No value present for key: 'zone-id' {{(pid=65306) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1224.694563] env[65306]: DEBUG dogpile.lock [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Calling creation function for not-yet-present value {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1224.694704] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1224.717034] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1224.717408] env[65306]: DEBUG dogpile.cache.region [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65306) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1224.717690] env[65306]: DEBUG dogpile.lock [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Released creation lock {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1224.717872] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "network-540" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1224.718293] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock port-da5bc795-50e3-4ce5-995a-d956b45b5c7b taken with stack trace [, , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1224.718501] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "port-da5bc795-50e3-4ce5-995a-d956b45b5c7b" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1224.718631] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "port-da5bc795-50e3-4ce5-995a-d956b45b5c7b" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1224.719012] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "port-da5bc795-50e3-4ce5-995a-d956b45b5c7b" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1224.719170] env[65306]: DEBUG networking_nsxv3.api.rpc [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('da5bc795-50e3-4ce5-995a-d956b45b5c7b',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1224.809712] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a70508b0-bb5b-4d0d-af41-b80fbdcfe90e',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1225.222529] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.222909] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.223783] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.224178] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.224385] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.224585] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Segment Port da5bc795-50e3-4ce5-995a-d956b45b5c7b not found, creating... [ 1225.224972] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.225303] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.225489] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.225756] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.225975] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.226335] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.226793] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.226793] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.226903] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.227014] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.227219] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Resource: SegmentPort with ID: da5bc795-50e3-4ce5-995a-d956b45b5c7b is going to be created. [ 1225.257172] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.257480] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.257606] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.257877] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.258152] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.258440] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "port-da5bc795-50e3-4ce5-995a-d956b45b5c7b" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.312233] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a70508b0-bb5b-4d0d-af41-b80fbdcfe90e',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1225.814565] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.814803] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.814803] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.815095] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.815222] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.815353] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a70508b0-bb5b-4d0d-af41-b80fbdcfe90e is going to be updated. [ 1225.875721] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.875945] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.876058] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.876290] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.876443] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.887523] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a70508b0-bb5b-4d0d-af41-b80fbdcfe90e in Status: IN_PROGRESS for 2s [ 1225.998278] env[65306]: INFO networking_nsxv3.common.synchronization [req-87d84eaa-c004-469a-9167-f7e9f30ff277 req-b4457076-9714-409c-bc64-be0409dd0974 service nova] Enqueued Resource ID: a70508b0-bb5b-4d0d-af41-b80fbdcfe90e with Priority: HIGHEST for action security_group_rules [ 1225.998547] env[65306]: INFO networking_nsxv3.common.synchronization [req-87d84eaa-c004-469a-9167-f7e9f30ff277 req-b4457076-9714-409c-bc64-be0409dd0974 service nova] Enqueued Resource ID: a70508b0-bb5b-4d0d-af41-b80fbdcfe90e with Priority: HIGHEST for action security_group_members [ 1225.998692] env[65306]: INFO networking_nsxv3.common.synchronization [req-87d84eaa-c004-469a-9167-f7e9f30ff277 req-b4457076-9714-409c-bc64-be0409dd0974 service nova] Enqueued Resource ID: da5bc795-50e3-4ce5-995a-d956b45b5c7b with Priority: HIGHEST for action port [ 1225.999256] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a70508b0-bb5b-4d0d-af41-b80fbdcfe90e with Priority: HIGHEST for action security_group_rules [ 1225.999395] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a70508b0-bb5b-4d0d-af41-b80fbdcfe90e with Priority: HIGHEST for action security_group_members [ 1225.999493] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: da5bc795-50e3-4ce5-995a-d956b45b5c7b with Priority: HIGHEST for action port [ 1225.999776] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a70508b0-bb5b-4d0d-af41-b80fbdcfe90e taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.999904] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a70508b0-bb5b-4d0d-af41-b80fbdcfe90e" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.000020] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a70508b0-bb5b-4d0d-af41-b80fbdcfe90e" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.004303] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a70508b0-bb5b-4d0d-af41-b80fbdcfe90e" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.004406] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a70508b0-bb5b-4d0d-af41-b80fbdcfe90e',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1226.005812] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-a70508b0-bb5b-4d0d-af41-b80fbdcfe90e taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.005928] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a70508b0-bb5b-4d0d-af41-b80fbdcfe90e" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.006174] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock port-da5bc795-50e3-4ce5-995a-d956b45b5c7b taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.006285] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-da5bc795-50e3-4ce5-995a-d956b45b5c7b" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.006366] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-da5bc795-50e3-4ce5-995a-d956b45b5c7b" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.006557] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-da5bc795-50e3-4ce5-995a-d956b45b5c7b" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.006637] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('da5bc795-50e3-4ce5-995a-d956b45b5c7b',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1226.274367] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6e403189-fcac-40e3-aa50-4c17f4d29895 in Status: SUCCESS [ 1226.274790] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6e403189-fcac-40e3-aa50-4c17f4d29895" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.274901] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6e403189-fcac-40e3-aa50-4c17f4d29895" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.275214] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6e403189-fcac-40e3-aa50-4c17f4d29895" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.275459] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.275590] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.275663] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.275953] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.275953] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.276055] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6e403189-fcac-40e3-aa50-4c17f4d29895" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.276173] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6e403189-fcac-40e3-aa50-4c17f4d29895',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1226.510377] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port da5bc795-50e3-4ce5-995a-d956b45b5c7b with status ACTIVE [ 1226.510730] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.511115] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.511115] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.511446] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.511446] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.512084] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.512084] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.512084] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.512243] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.512243] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.515656] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.515656] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.515656] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.515656] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.515656] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.515656] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: da5bc795-50e3-4ce5-995a-d956b45b5c7b is going to be updated. [ 1226.515656] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-a70508b0-bb5b-4d0d-af41-b80fbdcfe90e taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.515656] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a70508b0-bb5b-4d0d-af41-b80fbdcfe90e" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.535596] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.535879] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.535879] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.536237] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.536444] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.536658] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-da5bc795-50e3-4ce5-995a-d956b45b5c7b" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.779231] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6e403189-fcac-40e3-aa50-4c17f4d29895',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1227.280787] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6e403189-fcac-40e3-aa50-4c17f4d29895: rpc.has_security_group_logging(os_id): False [ 1227.300017] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1227.300220] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1227.300276] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1227.300512] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1227.300579] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1227.300827] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1227.301013] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1227.301090] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1227.301256] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1227.301337] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1227.301505] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6e403189-fcac-40e3-aa50-4c17f4d29895 is going to be updated. [ 1227.366521] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1227.366660] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1227.366941] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1227.366941] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1227.367084] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1227.383110] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6e403189-fcac-40e3-aa50-4c17f4d29895 in Status: IN_PROGRESS for 2s [ 1227.900028] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a70508b0-bb5b-4d0d-af41-b80fbdcfe90e in Status: SUCCESS [ 1227.900184] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a70508b0-bb5b-4d0d-af41-b80fbdcfe90e" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1227.900391] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a70508b0-bb5b-4d0d-af41-b80fbdcfe90e" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1227.900654] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a70508b0-bb5b-4d0d-af41-b80fbdcfe90e" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1227.900916] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1227.901105] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1227.901210] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1227.901383] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1227.901484] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1227.901615] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a70508b0-bb5b-4d0d-af41-b80fbdcfe90e',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1228.408064] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a70508b0-bb5b-4d0d-af41-b80fbdcfe90e',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1228.910138] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a70508b0-bb5b-4d0d-af41-b80fbdcfe90e',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1229.396417] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6e403189-fcac-40e3-aa50-4c17f4d29895 in Status: SUCCESS [ 1229.396637] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6e403189-fcac-40e3-aa50-4c17f4d29895" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1229.413237] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1229.413521] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1229.413521] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1229.413652] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1229.413960] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1229.413960] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a70508b0-bb5b-4d0d-af41-b80fbdcfe90e is going to be updated. [ 1229.443071] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1229.443245] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1229.443305] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1229.443523] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1229.443675] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1229.454178] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a70508b0-bb5b-4d0d-af41-b80fbdcfe90e in Status: IN_PROGRESS for 2s [ 1229.927041] env[65306]: INFO networking_nsxv3.common.synchronization [req-7f6fd296-3348-4b1a-afc3-80eed8907e41 req-329941c0-524d-4a03-933d-b0f1672d3b97 tempest-ServerActionsTestOtherB-1027609472 tempest-ServerActionsTestOtherB-1027609472-project-member] Enqueued Resource ID: 37349b8b-c2c1-4141-8b10-752c27492cbd with Priority: HIGHEST for action security_group_members [ 1229.927684] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 37349b8b-c2c1-4141-8b10-752c27492cbd with Priority: HIGHEST for action security_group_members [ 1229.928048] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-37349b8b-c2c1-4141-8b10-752c27492cbd taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1229.928170] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-37349b8b-c2c1-4141-8b10-752c27492cbd" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1229.928239] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-37349b8b-c2c1-4141-8b10-752c27492cbd" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1229.928781] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-37349b8b-c2c1-4141-8b10-752c27492cbd" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1229.928781] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1229.928781] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1229.928968] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1229.928968] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1229.929099] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1229.929197] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('37349b8b-c2c1-4141-8b10-752c27492cbd',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1230.433392] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.433758] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.433758] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.433923] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.433994] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.434199] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.434324] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.434383] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.434502] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.434562] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.434655] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 37349b8b-c2c1-4141-8b10-752c27492cbd is going to be updated. [ 1230.467388] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.467547] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.467667] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.467845] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.467990] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.477196] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 37349b8b-c2c1-4141-8b10-752c27492cbd in Status: IN_PROGRESS for 2s [ 1231.465568] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a70508b0-bb5b-4d0d-af41-b80fbdcfe90e in Status: SUCCESS [ 1231.465924] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a70508b0-bb5b-4d0d-af41-b80fbdcfe90e" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.466292] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a70508b0-bb5b-4d0d-af41-b80fbdcfe90e" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.466369] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a70508b0-bb5b-4d0d-af41-b80fbdcfe90e" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.466582] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.466747] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.466839] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.467080] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.467235] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.467338] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a70508b0-bb5b-4d0d-af41-b80fbdcfe90e" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.467445] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a70508b0-bb5b-4d0d-af41-b80fbdcfe90e',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1231.969987] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a70508b0-bb5b-4d0d-af41-b80fbdcfe90e',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1232.472894] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a70508b0-bb5b-4d0d-af41-b80fbdcfe90e: rpc.has_security_group_logging(os_id): False [ 1232.491484] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 37349b8b-c2c1-4141-8b10-752c27492cbd in Status: SUCCESS [ 1232.491733] env[65306]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 37349b8b-c2c1-4141-8b10-752c27492cbd deletion is rescheduled due to dependency. [ 1232.491916] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-37349b8b-c2c1-4141-8b10-752c27492cbd" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1232.493672] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1232.493827] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1232.493912] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1232.494163] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1232.494256] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1232.494525] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1232.494629] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1232.494727] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1232.494848] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1232.494945] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1232.495010] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a70508b0-bb5b-4d0d-af41-b80fbdcfe90e is going to be updated. [ 1232.561166] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1232.561367] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1232.561442] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1232.561678] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1232.561911] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1232.580697] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a70508b0-bb5b-4d0d-af41-b80fbdcfe90e in Status: IN_PROGRESS for 2s [ 1234.600220] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a70508b0-bb5b-4d0d-af41-b80fbdcfe90e in Status: SUCCESS [ 1234.600646] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a70508b0-bb5b-4d0d-af41-b80fbdcfe90e" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.928775] env[65306]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1234.929084] env[65306]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1237.104896] env[65306]: INFO networking_nsxv3.common.synchronization [None req-e6003172-2fc2-4a8c-9868-9f9846e71a30 tempest-AttachInterfacesTestJSON-144464476 tempest-AttachInterfacesTestJSON-144464476-project-member] Enqueued Resource ID: 60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d with Priority: HIGHEST for action security_group_members [ 1237.105895] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d with Priority: HIGHEST for action security_group_members [ 1237.105895] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.105895] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.105895] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1237.106526] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1237.106526] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.106526] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.106526] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1237.106684] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1237.106718] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1237.106798] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1237.609702] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.609911] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.609956] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1237.610198] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1237.610317] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1237.610637] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.610766] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.610836] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1237.611017] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1237.611108] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1237.611202] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d is going to be updated. [ 1237.644882] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.645157] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.645312] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1237.645537] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1237.645703] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1237.658983] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d in Status: IN_PROGRESS for 2s [ 1239.669117] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d in Status: SUCCESS [ 1239.669473] env[65306]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d deletion is rescheduled due to dependency. [ 1239.669473] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1241.790167] env[65306]: INFO networking_nsxv3.common.synchronization [req-c9ea62e6-d2b1-4f64-a9c4-e3549d41e4a1 req-3710e4cd-7e43-45cd-b942-411b19b11078 tempest-ServerActionsTestOtherA-65612913 tempest-ServerActionsTestOtherA-65612913-project-member] Enqueued Resource ID: 2536346e-d62c-4c9f-a652-a4136cc7ff65 with Priority: HIGHEST for action security_group_members [ 1241.790452] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2536346e-d62c-4c9f-a652-a4136cc7ff65 with Priority: HIGHEST for action security_group_members [ 1241.791726] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-2536346e-d62c-4c9f-a652-a4136cc7ff65 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1241.791726] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2536346e-d62c-4c9f-a652-a4136cc7ff65" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1241.791726] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2536346e-d62c-4c9f-a652-a4136cc7ff65" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1241.791726] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2536346e-d62c-4c9f-a652-a4136cc7ff65" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1241.792109] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1241.792235] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1241.792337] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1241.792545] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1241.792648] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1241.792826] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2536346e-d62c-4c9f-a652-a4136cc7ff65',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1242.156308] env[65306]: INFO networking_nsxv3.common.synchronization [req-3f2f5680-5b45-42d9-a652-c3d8725ce1c6 req-72b03441-516d-49ca-b3e7-33bf49e01b83 tempest-DeleteServersTestJSON-1340326246 tempest-DeleteServersTestJSON-1340326246-project-member] Enqueued Resource ID: d82bad56-9830-4c7d-9763-6d8a05e0998c with Priority: HIGHEST for action security_group_members [ 1242.156944] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d82bad56-9830-4c7d-9763-6d8a05e0998c with Priority: HIGHEST for action security_group_members [ 1242.157307] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-d82bad56-9830-4c7d-9763-6d8a05e0998c taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.157435] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d82bad56-9830-4c7d-9763-6d8a05e0998c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.157516] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d82bad56-9830-4c7d-9763-6d8a05e0998c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1242.157753] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d82bad56-9830-4c7d-9763-6d8a05e0998c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1242.157915] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.158057] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.158125] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1242.158298] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1242.158394] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.158521] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d82bad56-9830-4c7d-9763-6d8a05e0998c',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1242.296888] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.297207] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.297329] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1242.297671] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1242.297789] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.298066] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.298236] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.298341] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1242.298581] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1242.298674] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.298773] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2536346e-d62c-4c9f-a652-a4136cc7ff65 is going to be updated. [ 1242.334044] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.334298] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.334298] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1242.334456] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1242.334627] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.345072] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2536346e-d62c-4c9f-a652-a4136cc7ff65 in Status: IN_PROGRESS for 2s [ 1242.660796] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.661044] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.661126] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1242.661361] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1242.661487] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.661709] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.661825] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.661887] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1242.662124] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1242.662237] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.662341] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d82bad56-9830-4c7d-9763-6d8a05e0998c is going to be updated. [ 1242.692430] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.692615] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.692672] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1242.692888] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1242.693069] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.702696] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d82bad56-9830-4c7d-9763-6d8a05e0998c in Status: IN_PROGRESS for 2s [ 1244.355904] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2536346e-d62c-4c9f-a652-a4136cc7ff65 in Status: SUCCESS [ 1244.355904] env[65306]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2536346e-d62c-4c9f-a652-a4136cc7ff65 deletion is rescheduled due to dependency. [ 1244.355904] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2536346e-d62c-4c9f-a652-a4136cc7ff65" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.713906] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d82bad56-9830-4c7d-9763-6d8a05e0998c in Status: SUCCESS [ 1244.714110] env[65306]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d82bad56-9830-4c7d-9763-6d8a05e0998c deletion is rescheduled due to dependency. [ 1244.714248] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d82bad56-9830-4c7d-9763-6d8a05e0998c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.130402] env[65306]: INFO networking_nsxv3.common.synchronization [None req-9e880279-730a-41ac-8fa0-949c7ba4b2e0 tempest-ServerActionsTestOtherA-65612913 tempest-ServerActionsTestOtherA-65612913-project-member] Enqueued Resource ID: 24148ee6-c16b-47cd-97f7-9716f2d1e6b4 with Priority: HIGHEST for action security_group_rules [ 1246.130935] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 24148ee6-c16b-47cd-97f7-9716f2d1e6b4 with Priority: HIGHEST for action security_group_rules [ 1246.131256] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock rules-24148ee6-c16b-47cd-97f7-9716f2d1e6b4 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.131392] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-24148ee6-c16b-47cd-97f7-9716f2d1e6b4" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.131468] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-24148ee6-c16b-47cd-97f7-9716f2d1e6b4" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.131749] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-24148ee6-c16b-47cd-97f7-9716f2d1e6b4" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.131871] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('24148ee6-c16b-47cd-97f7-9716f2d1e6b4',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1246.218474] env[65306]: INFO networking_nsxv3.common.synchronization [None req-3667bf3d-dc5d-440f-a59b-78294ab691ae tempest-ServerActionsTestOtherA-65612913 tempest-ServerActionsTestOtherA-65612913-project-member] Enqueued Resource ID: 24148ee6-c16b-47cd-97f7-9716f2d1e6b4 with Priority: HIGHEST for action security_group_rules [ 1246.218875] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 24148ee6-c16b-47cd-97f7-9716f2d1e6b4 with Priority: HIGHEST for action security_group_rules [ 1246.219167] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock rules-24148ee6-c16b-47cd-97f7-9716f2d1e6b4 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.219308] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-24148ee6-c16b-47cd-97f7-9716f2d1e6b4" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.654374] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.654596] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.654674] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.655027] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.655027] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.655231] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 24148ee6-c16b-47cd-97f7-9716f2d1e6b4 already deleted. [ 1246.655231] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-24148ee6-c16b-47cd-97f7-9716f2d1e6b4" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.655328] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-24148ee6-c16b-47cd-97f7-9716f2d1e6b4" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.656034] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-24148ee6-c16b-47cd-97f7-9716f2d1e6b4" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.656034] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('24148ee6-c16b-47cd-97f7-9716f2d1e6b4',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1247.176293] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.176637] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.176637] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.176713] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.176800] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.176908] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 24148ee6-c16b-47cd-97f7-9716f2d1e6b4 already deleted. [ 1247.177059] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-24148ee6-c16b-47cd-97f7-9716f2d1e6b4" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1251.220264] env[65306]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1251.220612] env[65306]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1251.703761] env[65306]: INFO networking_nsxv3.common.synchronization [req-eccef396-fe08-4634-9e43-7dc46e16fd36 req-db60f8b5-04eb-4cc6-b4a6-8dc0622e7826 tempest-ServerActionsTestOtherA-65612913 tempest-ServerActionsTestOtherA-65612913-project-member] Enqueued Resource ID: 24148ee6-c16b-47cd-97f7-9716f2d1e6b4 with Priority: HIGHEST for action security_group_members [ 1251.704326] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 24148ee6-c16b-47cd-97f7-9716f2d1e6b4 with Priority: HIGHEST for action security_group_members [ 1251.705029] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-24148ee6-c16b-47cd-97f7-9716f2d1e6b4 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1251.705029] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-24148ee6-c16b-47cd-97f7-9716f2d1e6b4" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1251.705029] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-24148ee6-c16b-47cd-97f7-9716f2d1e6b4" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1251.705029] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-24148ee6-c16b-47cd-97f7-9716f2d1e6b4" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1251.705258] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1251.705318] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1251.706026] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1251.706026] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1251.706026] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1251.706026] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('24148ee6-c16b-47cd-97f7-9716f2d1e6b4',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1252.018555] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock network-435 taken with stack trace [, , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.018891] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "network-435" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.018979] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "network-435" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.019338] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "network-435" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.019685] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.019871] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.019991] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.020226] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.020376] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.020588] env[65306]: DEBUG dogpile.cache.region [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] No value present for key: 'zone-id' {{(pid=65306) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1252.020761] env[65306]: DEBUG dogpile.lock [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] NeedRegenerationException {{(pid=65306) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1252.020833] env[65306]: DEBUG dogpile.lock [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] no value, waiting for create lock {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1252.020925] env[65306]: DEBUG dogpile.lock [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] value creation lock acquired {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1252.021038] env[65306]: DEBUG dogpile.cache.region [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] No value present for key: 'zone-id' {{(pid=65306) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1252.021127] env[65306]: DEBUG dogpile.lock [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Calling creation function for not-yet-present value {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1252.021271] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1252.064356] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1252.064356] env[65306]: DEBUG dogpile.cache.region [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Cache value generated in 0.042 seconds for key(s): 'zone-id' {{(pid=65306) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1252.064356] env[65306]: DEBUG dogpile.lock [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Released creation lock {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1252.064356] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "network-435" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.064356] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock port-b9d328ab-d82c-4fb4-af2c-dd4a3213f3d8 taken with stack trace [, , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.064356] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "port-b9d328ab-d82c-4fb4-af2c-dd4a3213f3d8" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.064356] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "port-b9d328ab-d82c-4fb4-af2c-dd4a3213f3d8" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.064967] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "port-b9d328ab-d82c-4fb4-af2c-dd4a3213f3d8" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.064967] env[65306]: DEBUG networking_nsxv3.api.rpc [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b9d328ab-d82c-4fb4-af2c-dd4a3213f3d8',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1252.209277] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.209497] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.209497] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.209730] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.209821] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.210328] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.210328] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.210328] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.210328] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.210562] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.210562] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 24148ee6-c16b-47cd-97f7-9716f2d1e6b4 already deleted. [ 1252.210562] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-24148ee6-c16b-47cd-97f7-9716f2d1e6b4" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.567365] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.567795] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.567795] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.567970] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.568127] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.568295] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Segment Port b9d328ab-d82c-4fb4-af2c-dd4a3213f3d8 not found, creating... [ 1252.568551] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.568703] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.568815] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.569043] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.569179] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.569450] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.569603] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.569715] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.569913] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.570052] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.570188] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Resource: SegmentPort with ID: b9d328ab-d82c-4fb4-af2c-dd4a3213f3d8 is going to be created. [ 1252.590268] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.590454] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.590584] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.590784] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.591016] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.591243] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "port-b9d328ab-d82c-4fb4-af2c-dd4a3213f3d8" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1253.281565] env[65306]: INFO networking_nsxv3.common.synchronization [req-eccef396-fe08-4634-9e43-7dc46e16fd36 req-f4099561-16d6-4e15-8f7f-daafbbca4514 service nova] Enqueued Resource ID: 24148ee6-c16b-47cd-97f7-9716f2d1e6b4 with Priority: HIGHEST for action security_group_rules [ 1253.281827] env[65306]: INFO networking_nsxv3.common.synchronization [req-eccef396-fe08-4634-9e43-7dc46e16fd36 req-f4099561-16d6-4e15-8f7f-daafbbca4514 service nova] Enqueued Resource ID: 24148ee6-c16b-47cd-97f7-9716f2d1e6b4 with Priority: HIGHEST for action security_group_members [ 1253.282053] env[65306]: INFO networking_nsxv3.common.synchronization [req-eccef396-fe08-4634-9e43-7dc46e16fd36 req-f4099561-16d6-4e15-8f7f-daafbbca4514 service nova] Enqueued Resource ID: b9d328ab-d82c-4fb4-af2c-dd4a3213f3d8 with Priority: HIGHEST for action port [ 1253.282632] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 24148ee6-c16b-47cd-97f7-9716f2d1e6b4 with Priority: HIGHEST for action security_group_rules [ 1253.282716] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 24148ee6-c16b-47cd-97f7-9716f2d1e6b4 with Priority: HIGHEST for action security_group_members [ 1253.282822] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b9d328ab-d82c-4fb4-af2c-dd4a3213f3d8 with Priority: HIGHEST for action port [ 1253.283345] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock rules-24148ee6-c16b-47cd-97f7-9716f2d1e6b4 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1253.283478] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-24148ee6-c16b-47cd-97f7-9716f2d1e6b4" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1253.283478] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-24148ee6-c16b-47cd-97f7-9716f2d1e6b4" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1253.283644] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-24148ee6-c16b-47cd-97f7-9716f2d1e6b4" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1253.283751] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('24148ee6-c16b-47cd-97f7-9716f2d1e6b4',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1253.284736] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-24148ee6-c16b-47cd-97f7-9716f2d1e6b4 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1253.284954] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-24148ee6-c16b-47cd-97f7-9716f2d1e6b4" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1253.285059] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-24148ee6-c16b-47cd-97f7-9716f2d1e6b4" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1253.285281] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-24148ee6-c16b-47cd-97f7-9716f2d1e6b4" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1253.285541] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1253.285716] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1253.285801] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1253.286390] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1253.286682] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1253.286682] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('24148ee6-c16b-47cd-97f7-9716f2d1e6b4',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1253.287484] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock port-b9d328ab-d82c-4fb4-af2c-dd4a3213f3d8 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1253.287597] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b9d328ab-d82c-4fb4-af2c-dd4a3213f3d8" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1253.287666] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b9d328ab-d82c-4fb4-af2c-dd4a3213f3d8" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1253.287850] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b9d328ab-d82c-4fb4-af2c-dd4a3213f3d8" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1253.287961] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b9d328ab-d82c-4fb4-af2c-dd4a3213f3d8',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1253.790866] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-24148ee6-c16b-47cd-97f7-9716f2d1e6b4 taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1253.790866] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-24148ee6-c16b-47cd-97f7-9716f2d1e6b4" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1253.790866] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('24148ee6-c16b-47cd-97f7-9716f2d1e6b4',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1253.791572] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b9d328ab-d82c-4fb4-af2c-dd4a3213f3d8 with status ACTIVE [ 1253.791572] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1253.791572] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1253.791572] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1253.791756] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1253.791810] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1253.791979] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1253.792079] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1253.792681] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1253.792681] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1253.792681] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1253.792681] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1253.792681] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1253.792681] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1253.792950] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1253.792950] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1253.792950] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b9d328ab-d82c-4fb4-af2c-dd4a3213f3d8 is going to be updated. [ 1253.815490] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1253.815727] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1253.815727] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1253.815890] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1253.816033] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1253.816206] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b9d328ab-d82c-4fb4-af2c-dd4a3213f3d8" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1253.993838] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock network-540 taken with stack trace [, , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1253.994061] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "network-540" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1253.994190] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "network-540" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1253.994494] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "network-540" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1253.994751] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1253.994911] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1253.995041] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1253.995305] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1253.995472] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1253.995684] env[65306]: DEBUG dogpile.cache.region [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] No value present for key: 'zone-id' {{(pid=65306) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1253.995799] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] NeedRegenerationException {{(pid=65306) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1253.995910] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] no value, waiting for create lock {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1253.996032] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] value creation lock acquired {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1253.996662] env[65306]: DEBUG dogpile.cache.region [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] No value present for key: 'zone-id' {{(pid=65306) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1253.996662] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Calling creation function for not-yet-present value {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1253.996662] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1254.016588] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1254.016767] env[65306]: DEBUG dogpile.cache.region [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65306) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1254.016907] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Released creation lock {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1254.017103] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "network-540" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1254.017453] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock port-9d9559a0-e394-4125-8703-eb90adc7374d taken with stack trace [, , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1254.017640] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "port-9d9559a0-e394-4125-8703-eb90adc7374d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1254.017767] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "port-9d9559a0-e394-4125-8703-eb90adc7374d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1254.018199] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "port-9d9559a0-e394-4125-8703-eb90adc7374d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1254.018280] env[65306]: DEBUG networking_nsxv3.api.rpc [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9d9559a0-e394-4125-8703-eb90adc7374d',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1254.295102] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('24148ee6-c16b-47cd-97f7-9716f2d1e6b4',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1254.520674] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1254.520948] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1254.521095] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1254.521377] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1254.521533] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1254.521690] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Segment Port 9d9559a0-e394-4125-8703-eb90adc7374d not found, creating... [ 1254.521945] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1254.522133] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1254.522273] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1254.522524] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1254.522720] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1254.522949] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1254.523132] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1254.523280] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1254.523487] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1254.523653] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1254.523809] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Resource: SegmentPort with ID: 9d9559a0-e394-4125-8703-eb90adc7374d is going to be created. [ 1254.543632] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1254.543835] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1254.543936] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1254.544337] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1254.544459] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1254.544693] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "port-9d9559a0-e394-4125-8703-eb90adc7374d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1254.799090] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1254.799445] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1254.799445] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1254.799696] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1254.799793] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1254.799896] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 24148ee6-c16b-47cd-97f7-9716f2d1e6b4 is going to be created. [ 1254.825585] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1254.825802] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1254.825802] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1254.825983] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1254.826153] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1254.836203] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 24148ee6-c16b-47cd-97f7-9716f2d1e6b4 in Status: UNINITIALIZED for 2s [ 1255.123705] env[65306]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-fe90dfa9-7944-46fc-be94-0b3a151ba91d None None] NSXv3 Agent Agent loop - iteration:2 completed [ 1255.123841] env[65306]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-fe90dfa9-7944-46fc-be94-0b3a151ba91d None None] NSXv3 Agent Agent loop - iteration:3 started [ 1255.240147] env[65306]: INFO networking_nsxv3.common.synchronization [req-7c7f143e-7f2b-4fa8-9cd3-07ee9194c5af req-5d7100c8-8f45-471d-b38e-bf191a0ee330 service nova] Enqueued Resource ID: 60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d with Priority: HIGHEST for action security_group_rules [ 1255.240338] env[65306]: INFO networking_nsxv3.common.synchronization [req-7c7f143e-7f2b-4fa8-9cd3-07ee9194c5af req-5d7100c8-8f45-471d-b38e-bf191a0ee330 service nova] Enqueued Resource ID: 60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d with Priority: HIGHEST for action security_group_members [ 1255.240479] env[65306]: INFO networking_nsxv3.common.synchronization [req-7c7f143e-7f2b-4fa8-9cd3-07ee9194c5af req-5d7100c8-8f45-471d-b38e-bf191a0ee330 service nova] Enqueued Resource ID: 9d9559a0-e394-4125-8703-eb90adc7374d with Priority: HIGHEST for action port [ 1255.240934] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d with Priority: HIGHEST for action security_group_rules [ 1255.241470] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d with Priority: HIGHEST for action security_group_members [ 1255.241602] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9d9559a0-e394-4125-8703-eb90adc7374d with Priority: HIGHEST for action port [ 1255.241892] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock rules-60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.242075] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.242215] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1255.242508] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1255.242597] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1255.244014] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.244136] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.244301] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1255.244493] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1255.244651] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.244748] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.244808] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1255.244978] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1255.245055] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1255.245169] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1255.246442] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock port-9d9559a0-e394-4125-8703-eb90adc7374d taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.246557] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9d9559a0-e394-4125-8703-eb90adc7374d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.246617] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9d9559a0-e394-4125-8703-eb90adc7374d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1255.246764] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9d9559a0-e394-4125-8703-eb90adc7374d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1255.246838] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9d9559a0-e394-4125-8703-eb90adc7374d',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1255.744620] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.744767] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.749308] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9d9559a0-e394-4125-8703-eb90adc7374d with status ACTIVE [ 1255.749362] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.749521] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.749521] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1255.749733] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1255.749825] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1255.750396] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.750396] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.750396] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1255.750396] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1255.750396] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1255.750663] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.750663] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.750744] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1255.750833] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1255.750898] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1255.750971] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9d9559a0-e394-4125-8703-eb90adc7374d is going to be updated. [ 1255.752078] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1255.773833] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.773833] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.773833] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1255.774044] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1255.774144] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1255.774221] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9d9559a0-e394-4125-8703-eb90adc7374d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.254657] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1256.759071] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.759233] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.759310] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.759535] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.759620] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.759722] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d is going to be updated. [ 1256.788507] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.788721] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.788721] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.788869] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.789019] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.797415] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d in Status: IN_PROGRESS for 2s [ 1256.844973] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 24148ee6-c16b-47cd-97f7-9716f2d1e6b4 in Status: SUCCESS [ 1256.845318] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-24148ee6-c16b-47cd-97f7-9716f2d1e6b4" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.845520] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-24148ee6-c16b-47cd-97f7-9716f2d1e6b4" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.845727] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-24148ee6-c16b-47cd-97f7-9716f2d1e6b4" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.845912] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.846043] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.846109] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.846254] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.846337] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.846421] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-24148ee6-c16b-47cd-97f7-9716f2d1e6b4" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.846509] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('24148ee6-c16b-47cd-97f7-9716f2d1e6b4',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1257.348950] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('24148ee6-c16b-47cd-97f7-9716f2d1e6b4',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1257.851497] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 24148ee6-c16b-47cd-97f7-9716f2d1e6b4: rpc.has_security_group_logging(os_id): False [ 1257.873607] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.873815] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.873866] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.874074] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.874191] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.874439] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.874586] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.874691] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.874755] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.874825] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.874935] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 24148ee6-c16b-47cd-97f7-9716f2d1e6b4 is going to be created. [ 1257.946538] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.946780] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.946780] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.946955] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.947158] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.961513] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 24148ee6-c16b-47cd-97f7-9716f2d1e6b4 in Status: IN_PROGRESS for 2s [ 1258.808461] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d in Status: SUCCESS [ 1258.808815] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1258.808884] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1258.809135] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1258.809364] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1258.809539] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1258.809653] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1258.809846] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1258.809933] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1258.810055] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1258.810158] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1259.315909] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1259.316171] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1259.316171] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1259.316421] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1259.316614] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1259.316724] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1259.316789] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1259.316953] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1259.317065] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1259.317156] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1259.317311] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1259.317399] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1259.317456] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1259.317631] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1259.317744] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1259.317828] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1259.317878] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1259.318031] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1259.318109] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1259.318190] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1259.318276] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1259.820436] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d: rpc.has_security_group_logging(os_id): False [ 1259.843430] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1259.843576] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1259.843650] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1259.843866] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1259.843958] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1259.844163] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1259.844259] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1259.844323] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1259.844476] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1259.844891] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1259.844891] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1259.845045] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1259.845045] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1259.845175] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1259.845243] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1259.845633] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1259.845766] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1259.845921] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1259.846155] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1259.846235] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1259.846334] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d is going to be updated. [ 1259.910015] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1259.910243] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1259.910243] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1259.910621] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1259.910802] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1259.926751] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d in Status: IN_PROGRESS for 2s [ 1259.990608] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 24148ee6-c16b-47cd-97f7-9716f2d1e6b4 in Status: SUCCESS [ 1259.990903] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-24148ee6-c16b-47cd-97f7-9716f2d1e6b4" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.242695] env[65306]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1260.242922] env[65306]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1260.277800] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock network-270 taken with stack trace [, , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.278989] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "network-270" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.278989] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "network-270" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.278989] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "network-270" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.279267] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.279390] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.279552] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.279868] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.280115] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.280376] env[65306]: DEBUG dogpile.cache.region [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] No value present for key: 'zone-id' {{(pid=65306) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1260.280511] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] NeedRegenerationException {{(pid=65306) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1260.280623] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] no value, waiting for create lock {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1260.280781] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] value creation lock acquired {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1260.280905] env[65306]: DEBUG dogpile.cache.region [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] No value present for key: 'zone-id' {{(pid=65306) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1260.281044] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Calling creation function for not-yet-present value {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1260.281182] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1260.305216] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1260.305462] env[65306]: DEBUG dogpile.cache.region [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65306) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1260.305651] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Released creation lock {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1260.305898] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "network-270" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.306357] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock port-341fc765-f45c-46ba-abd4-bb9992b32b9c taken with stack trace [, , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.306657] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "port-341fc765-f45c-46ba-abd4-bb9992b32b9c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.306784] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "port-341fc765-f45c-46ba-abd4-bb9992b32b9c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.307127] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "port-341fc765-f45c-46ba-abd4-bb9992b32b9c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.307325] env[65306]: DEBUG networking_nsxv3.api.rpc [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('341fc765-f45c-46ba-abd4-bb9992b32b9c',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1260.809854] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.810096] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.810228] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.810516] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.810696] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.811203] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.811203] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.811348] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.811574] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.811715] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.811990] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.812157] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.812274] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.812478] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.812613] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.812751] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Resource: SegmentPort with ID: 341fc765-f45c-46ba-abd4-bb9992b32b9c is going to be updated. [ 1260.840731] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.841186] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.841186] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.841475] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.841721] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.842014] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "port-341fc765-f45c-46ba-abd4-bb9992b32b9c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1261.540767] env[65306]: INFO networking_nsxv3.common.synchronization [req-d4b20571-e18f-446c-baa9-f966a72b23af req-cab78479-b0ba-42f6-9d38-56b0933ee77c service nova] Enqueued Resource ID: e84d3263-5312-46e3-9331-fbbe9b6a7e85 with Priority: HIGHEST for action security_group_rules [ 1261.540947] env[65306]: INFO networking_nsxv3.common.synchronization [req-d4b20571-e18f-446c-baa9-f966a72b23af req-cab78479-b0ba-42f6-9d38-56b0933ee77c service nova] Enqueued Resource ID: e84d3263-5312-46e3-9331-fbbe9b6a7e85 with Priority: HIGHEST for action security_group_members [ 1261.541095] env[65306]: INFO networking_nsxv3.common.synchronization [req-d4b20571-e18f-446c-baa9-f966a72b23af req-cab78479-b0ba-42f6-9d38-56b0933ee77c service nova] Enqueued Resource ID: 341fc765-f45c-46ba-abd4-bb9992b32b9c with Priority: HIGHEST for action port [ 1261.541353] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e84d3263-5312-46e3-9331-fbbe9b6a7e85 with Priority: HIGHEST for action security_group_rules [ 1261.541504] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e84d3263-5312-46e3-9331-fbbe9b6a7e85 with Priority: HIGHEST for action security_group_members [ 1261.541550] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 341fc765-f45c-46ba-abd4-bb9992b32b9c with Priority: HIGHEST for action port [ 1261.542574] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e84d3263-5312-46e3-9331-fbbe9b6a7e85 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1261.542735] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e84d3263-5312-46e3-9331-fbbe9b6a7e85" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1261.542808] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e84d3263-5312-46e3-9331-fbbe9b6a7e85" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1261.543021] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e84d3263-5312-46e3-9331-fbbe9b6a7e85" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1261.543152] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e84d3263-5312-46e3-9331-fbbe9b6a7e85',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1261.543983] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-e84d3263-5312-46e3-9331-fbbe9b6a7e85 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1261.544160] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e84d3263-5312-46e3-9331-fbbe9b6a7e85" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1261.544199] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e84d3263-5312-46e3-9331-fbbe9b6a7e85" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1261.544347] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e84d3263-5312-46e3-9331-fbbe9b6a7e85" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1261.544494] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1261.544590] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1261.544656] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1261.544798] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1261.544885] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1261.544973] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e84d3263-5312-46e3-9331-fbbe9b6a7e85',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1261.545782] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock port-341fc765-f45c-46ba-abd4-bb9992b32b9c taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1261.545987] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-341fc765-f45c-46ba-abd4-bb9992b32b9c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1261.546734] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-341fc765-f45c-46ba-abd4-bb9992b32b9c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1261.546851] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-341fc765-f45c-46ba-abd4-bb9992b32b9c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1261.547147] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('341fc765-f45c-46ba-abd4-bb9992b32b9c',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1261.942149] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d in Status: SUCCESS [ 1261.942545] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1262.049189] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-e84d3263-5312-46e3-9331-fbbe9b6a7e85 taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1262.049358] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e84d3263-5312-46e3-9331-fbbe9b6a7e85" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1262.049953] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e84d3263-5312-46e3-9331-fbbe9b6a7e85',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1262.050612] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 341fc765-f45c-46ba-abd4-bb9992b32b9c with status ACTIVE [ 1262.050710] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1262.050778] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1262.050816] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1262.051022] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1262.051113] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1262.051286] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1262.051385] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1262.051451] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1262.051605] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1262.051681] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1262.051859] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1262.051950] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1262.052020] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1262.052163] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1262.052241] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1262.052392] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 341fc765-f45c-46ba-abd4-bb9992b32b9c is going to be updated. [ 1262.074506] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1262.074705] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1262.074705] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1262.074909] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1262.075058] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1262.075222] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-341fc765-f45c-46ba-abd4-bb9992b32b9c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1262.554303] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e84d3263-5312-46e3-9331-fbbe9b6a7e85',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1263.056843] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1263.057448] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1263.057448] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1263.057448] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1263.057448] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1263.057693] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e84d3263-5312-46e3-9331-fbbe9b6a7e85 is going to be updated. [ 1263.089011] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1263.089204] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1263.089204] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1263.089383] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1263.089530] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1263.100500] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e84d3263-5312-46e3-9331-fbbe9b6a7e85 in Status: IN_PROGRESS for 2s [ 1265.112129] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e84d3263-5312-46e3-9331-fbbe9b6a7e85 in Status: SUCCESS [ 1265.112569] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e84d3263-5312-46e3-9331-fbbe9b6a7e85" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1265.112944] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e84d3263-5312-46e3-9331-fbbe9b6a7e85" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1265.113030] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e84d3263-5312-46e3-9331-fbbe9b6a7e85" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1265.113168] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.113384] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1265.113456] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1265.113695] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1265.113783] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1265.113869] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e84d3263-5312-46e3-9331-fbbe9b6a7e85" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1265.113958] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e84d3263-5312-46e3-9331-fbbe9b6a7e85',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1265.616865] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e84d3263-5312-46e3-9331-fbbe9b6a7e85',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1266.119426] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e84d3263-5312-46e3-9331-fbbe9b6a7e85: rpc.has_security_group_logging(os_id): False [ 1266.143416] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1266.143628] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1266.143740] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1266.144008] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1266.144223] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1266.144553] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1266.144704] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1266.144806] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1266.145072] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1266.145202] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1266.145334] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e84d3263-5312-46e3-9331-fbbe9b6a7e85 is going to be updated. [ 1266.211316] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1266.211522] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1266.211569] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1266.211855] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1266.212075] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1266.230065] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e84d3263-5312-46e3-9331-fbbe9b6a7e85 in Status: IN_PROGRESS for 2s [ 1266.542888] env[65306]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1266.543101] env[65306]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1267.079888] env[65306]: INFO networking_nsxv3.common.synchronization [req-95059d15-9c49-446a-a157-34e6a8856fa4 req-424962ec-04ec-4c0a-9048-11a093ec20d3 tempest-ServerRescueNegativeTestJSON-1491097463 tempest-ServerRescueNegativeTestJSON-1491097463-project-member] Enqueued Resource ID: 9672ecd6-e064-4287-b1ae-4b673c86ae96 with Priority: HIGHEST for action security_group_members [ 1267.079888] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9672ecd6-e064-4287-b1ae-4b673c86ae96 with Priority: HIGHEST for action security_group_members [ 1267.079888] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-9672ecd6-e064-4287-b1ae-4b673c86ae96 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.079888] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9672ecd6-e064-4287-b1ae-4b673c86ae96" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1267.079888] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9672ecd6-e064-4287-b1ae-4b673c86ae96" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1267.080597] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9672ecd6-e064-4287-b1ae-4b673c86ae96" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1267.080597] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.080597] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1267.080597] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1267.080761] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1267.080849] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.080950] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9672ecd6-e064-4287-b1ae-4b673c86ae96',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1267.584403] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.584838] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1267.584838] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1267.584838] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1267.584939] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.585238] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.585383] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1267.585498] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1267.585736] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1267.585860] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.585959] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9672ecd6-e064-4287-b1ae-4b673c86ae96 is going to be updated. [ 1267.611853] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.612108] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1267.612108] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1267.612286] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1267.612431] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.623038] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9672ecd6-e064-4287-b1ae-4b673c86ae96 in Status: IN_PROGRESS for 2s [ 1268.247304] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e84d3263-5312-46e3-9331-fbbe9b6a7e85 in Status: SUCCESS [ 1268.247539] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e84d3263-5312-46e3-9331-fbbe9b6a7e85" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1269.636415] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9672ecd6-e064-4287-b1ae-4b673c86ae96 in Status: SUCCESS [ 1269.636751] env[65306]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9672ecd6-e064-4287-b1ae-4b673c86ae96 deletion is rescheduled due to dependency. [ 1269.636751] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9672ecd6-e064-4287-b1ae-4b673c86ae96" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.424734] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock network-540 taken with stack trace [, , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.425113] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "network-540" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.425113] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "network-540" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.425340] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "network-540" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.425752] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.426017] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.426161] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.426497] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.426748] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.427026] env[65306]: DEBUG dogpile.cache.region [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] No value present for key: 'zone-id' {{(pid=65306) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1271.427152] env[65306]: DEBUG dogpile.lock [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] NeedRegenerationException {{(pid=65306) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1271.427263] env[65306]: DEBUG dogpile.lock [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] no value, waiting for create lock {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1271.427372] env[65306]: DEBUG dogpile.lock [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] value creation lock acquired {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1271.427483] env[65306]: DEBUG dogpile.cache.region [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] No value present for key: 'zone-id' {{(pid=65306) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1271.427587] env[65306]: DEBUG dogpile.lock [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Calling creation function for not-yet-present value {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1271.427724] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1271.451008] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1271.451205] env[65306]: DEBUG dogpile.cache.region [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65306) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1271.451325] env[65306]: DEBUG dogpile.lock [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Released creation lock {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1271.451517] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "network-540" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.451869] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock port-9d9559a0-e394-4125-8703-eb90adc7374d taken with stack trace [, , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.452057] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "port-9d9559a0-e394-4125-8703-eb90adc7374d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.452310] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "port-9d9559a0-e394-4125-8703-eb90adc7374d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.452601] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "port-9d9559a0-e394-4125-8703-eb90adc7374d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.452741] env[65306]: DEBUG networking_nsxv3.api.rpc [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9d9559a0-e394-4125-8703-eb90adc7374d',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1271.955779] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.956024] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.956218] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.956535] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.956693] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.956994] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.957172] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.957289] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.957580] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.957722] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.958051] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.958224] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.958344] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.958556] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.958750] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.958897] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Resource: SegmentPort with ID: 9d9559a0-e394-4125-8703-eb90adc7374d is going to be updated. [ 1271.998467] env[65306]: DEBUG networking_nsxv3.common.locking [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.998788] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.998936] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.999266] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.999479] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.999823] env[65306]: DEBUG oslo_concurrency.lockutils [None req-a9ac885a-1f8e-4523-8a9d-8df286e1f64c None None] Releasing lock "port-9d9559a0-e394-4125-8703-eb90adc7374d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.079632] env[65306]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1272.079632] env[65306]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1272.699644] env[65306]: INFO networking_nsxv3.common.synchronization [req-e2791818-76c8-48b9-a28c-aac8b8697001 req-e10fcc4c-3270-4da1-bdbc-872d37f5c820 service nova] Enqueued Resource ID: 60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d with Priority: HIGHEST for action security_group_rules [ 1272.699972] env[65306]: INFO networking_nsxv3.common.synchronization [req-e2791818-76c8-48b9-a28c-aac8b8697001 req-e10fcc4c-3270-4da1-bdbc-872d37f5c820 service nova] Enqueued Resource ID: 60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d with Priority: HIGHEST for action security_group_members [ 1272.699972] env[65306]: INFO networking_nsxv3.common.synchronization [req-e2791818-76c8-48b9-a28c-aac8b8697001 req-e10fcc4c-3270-4da1-bdbc-872d37f5c820 service nova] Enqueued Resource ID: 9d9559a0-e394-4125-8703-eb90adc7374d with Priority: HIGHEST for action port [ 1272.700731] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d with Priority: HIGHEST for action security_group_rules [ 1272.700939] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d with Priority: HIGHEST for action security_group_members [ 1272.701129] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9d9559a0-e394-4125-8703-eb90adc7374d with Priority: HIGHEST for action port [ 1272.701550] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock rules-60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.701946] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.701946] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.702173] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.702312] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1272.703491] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.703674] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.703799] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.704091] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.704324] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.704487] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.704597] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.704834] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.705135] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.705135] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1272.706267] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock port-9d9559a0-e394-4125-8703-eb90adc7374d taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.706429] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9d9559a0-e394-4125-8703-eb90adc7374d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.706429] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9d9559a0-e394-4125-8703-eb90adc7374d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.706592] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9d9559a0-e394-4125-8703-eb90adc7374d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.706672] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9d9559a0-e394-4125-8703-eb90adc7374d',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1273.209070] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.209070] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.209070] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1273.210014] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9d9559a0-e394-4125-8703-eb90adc7374d with status ACTIVE [ 1273.210109] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.210224] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.210291] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.210487] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.210600] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.210798] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.210904] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.211011] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.211192] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.211273] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.211459] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.211579] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.211648] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.211789] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.211886] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.211945] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9d9559a0-e394-4125-8703-eb90adc7374d is going to be updated. [ 1273.235421] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.235674] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.235752] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.235914] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.236073] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.236236] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9d9559a0-e394-4125-8703-eb90adc7374d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.714346] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1274.216618] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1274.216834] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1274.216834] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1274.216984] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1274.217096] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.217194] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d is going to be updated. [ 1274.246139] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1274.246349] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1274.246349] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1274.246520] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1274.246680] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.256466] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d in Status: IN_PROGRESS for 2s [ 1276.268288] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d in Status: SUCCESS [ 1276.268557] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1276.268716] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.268933] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.269326] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.269432] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.269487] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.269626] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.269704] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1276.269776] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1276.269921] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1276.772014] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.772189] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.772263] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.772486] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.772651] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.772751] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.772816] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.772965] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.773067] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1276.773156] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1276.773303] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.773399] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.773461] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.773634] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.773798] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.773892] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.773954] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.774112] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.774190] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1276.774272] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1276.774361] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1277.276410] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d: rpc.has_security_group_logging(os_id): False [ 1277.297178] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1277.297405] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1277.297506] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1277.297834] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1277.297991] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1277.298328] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1277.298513] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1277.298634] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1277.298919] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1277.299077] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1277.299396] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1277.299559] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1277.299689] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1277.299917] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1277.300091] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1277.300342] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1277.300464] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1277.300548] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1277.300745] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1277.300875] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1277.300971] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d is going to be updated. [ 1277.372965] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1277.373297] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1277.373297] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1277.373543] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1277.373739] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1277.398812] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d in Status: IN_PROGRESS for 2s [ 1277.702440] env[65306]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1277.702711] env[65306]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1278.910617] env[65306]: INFO networking_nsxv3.common.synchronization [req-ac760520-cc8b-4fce-ba4f-f2b79c40d3c8 req-96c64143-1d28-4f89-b61a-4a9c459388a8 tempest-ServerRescueNegativeTestJSON-1491097463 tempest-ServerRescueNegativeTestJSON-1491097463-project-member] Enqueued Resource ID: b8dc2b13-0f06-4660-ab7d-a65578892823 with Priority: HIGHEST for action security_group_members [ 1278.911065] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b8dc2b13-0f06-4660-ab7d-a65578892823 with Priority: HIGHEST for action security_group_members [ 1278.911368] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-b8dc2b13-0f06-4660-ab7d-a65578892823 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1278.911498] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b8dc2b13-0f06-4660-ab7d-a65578892823" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1278.911566] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b8dc2b13-0f06-4660-ab7d-a65578892823" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1278.911952] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b8dc2b13-0f06-4660-ab7d-a65578892823" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1278.911952] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1278.912079] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1278.912079] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1278.912210] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1278.912295] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1278.912394] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b8dc2b13-0f06-4660-ab7d-a65578892823',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1279.414070] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d in Status: SUCCESS [ 1279.414286] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.415699] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b8dc2b13-0f06-4660-ab7d-a65578892823',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1279.917365] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b8dc2b13-0f06-4660-ab7d-a65578892823',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1280.073205] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.073457] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.073457] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.073781] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.073927] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1280.419403] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.419621] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.419686] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.420048] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.420198] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.420355] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b8dc2b13-0f06-4660-ab7d-a65578892823 is going to be updated. [ 1280.450169] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.450302] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.450377] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.450595] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.450774] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.459450] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b8dc2b13-0f06-4660-ab7d-a65578892823 in Status: IN_PROGRESS for 2s [ 1280.576309] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1281.079753] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1281.582029] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 1281.582215] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 1282.344414] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1282.344414] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1282.344414] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1282.344882] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1282.358921] env[65306]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 1282.359787] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.360548] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 1282.395897] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1282.396199] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1282.396199] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1282.396334] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1282.409693] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.410568] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 1282.410666] env[65306]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=65306) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1282.410745] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 1282.505169] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b8dc2b13-0f06-4660-ab7d-a65578892823 in Status: SUCCESS [ 1282.505389] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b8dc2b13-0f06-4660-ab7d-a65578892823" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.521334] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1282.521588] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1282.521588] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1282.521861] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1282.523597] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.523829] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 1282.648934] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1282.649202] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1282.649202] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1282.649449] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1282.649816] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.650165] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 1282.748568] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1282.748884] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1282.748954] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1282.749294] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1282.749666] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.750070] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:48. [ 1282.750180] env[65306]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'b8dc2b13-0f06-4660-ab7d-a65578892823', '57bb6fe9-98c4-47f0-9daa-c424a0c9dfee', '9e80329d-1fcd-4c50-8991-a90e2a1fbdbc', '60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d', 'ac1808f0-d4d0-423f-abd5-9612116e67ac', '331be455-1cf8-4667-8d43-bd7a51712610', '0cb41b0f-cdd2-4222-95b4-bafd614b7460', '50a889c1-6336-4320-94ea-df1e6eaa778c', '1dfcba8d-33df-4f0e-919e-4904bde851ad', 'f2738afc-1df7-4958-9efd-71a6bbe54e6e', '979b0e99-7f65-434d-a9e9-1ff018f5b499', '37349b8b-c2c1-4141-8b10-752c27492cbd', '24148ee6-c16b-47cd-97f7-9716f2d1e6b4', 'e84d3263-5312-46e3-9331-fbbe9b6a7e85', 'e21f899c-0473-418d-9b8f-8591e9dc160f', '9672ecd6-e064-4287-b1ae-4b673c86ae96', '7c868cfd-e55d-4976-95db-5b3f64c76a5f', '1b97992b-9002-4b6e-b809-d68f93354c99', '3eee5457-701b-405e-bdf2-f055e0150d49', 'b9d469db-f694-4408-9c06-70ff03328f59', '17a26b80-c2ff-49b2-a30b-bd2b600f8787', '52d329d0-14c2-4610-ad32-9ade5237bab0', '7f22d913-90d3-4ccb-8780-b9dbc479a7d3', '56904b3c-38e4-4547-9a1d-cc787c3fef9d', 'dbcb04c7-d4cb-4ab9-8312-c80dffeeaa42', 'a70508b0-bb5b-4d0d-af41-b80fbdcfe90e', '3bf31731-6b75-4dfa-b76c-ee83bdf17eaa', '830915ca-b7ed-480d-8dcc-06210706a96a', '55a6ae08-0730-4d04-bc2c-3f0c36758315', 'd82bad56-9830-4c7d-9763-6d8a05e0998c', 'c3ffb1bc-84c3-4121-a677-8d413e70c9cc', '7b301620-e19b-4a95-9103-ce7982b7fa1d', 'a7dafaf4-f702-4dc9-bc77-265f5268966a', '23ae6942-da1d-46a7-951e-aa32b51f50d2', '2536346e-d62c-4c9f-a652-a4136cc7ff65', '5188a191-fc4a-4216-b94f-2b854c8abd88', '30524546-2ed3-474c-bf2b-fc6aff50dfec', '5ec09b70-aa5a-48ff-b72f-a5c6c81190e0', '4ccf00ad-53bf-45d0-a342-260b14c2ccf2', '5c095c1f-60f5-47d0-b270-e33f847ba33b', 'f5174f7c-dc12-4dad-9284-eed34d64b830', 'e3e0f6b2-2984-4938-adcc-0374a714ff76', 'c3a4b03d-2231-4b42-a522-be404c2784e5', '4603b17e-9032-4f9f-a8ac-9d7d5e34db46', '4e234e08-a192-4c7a-badf-3e57629854d7', '2cdaf88a-80a7-4019-9156-d7e0483af77f', 'a3364d7c-b2fd-4f01-932a-1feef0fa76de', '6e403189-fcac-40e3-aa50-4c17f4d29895'} {{(pid=65306) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1282.750300] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 1282.772043] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1282.772272] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1282.772331] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1282.772557] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1282.772664] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.772815] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 1282.772929] env[65306]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=65306) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1282.773050] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 1282.881316] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1282.881589] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1282.881589] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1282.881767] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1282.883020] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.883339] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 1282.883511] env[65306]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=65306) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1282.883511] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 1282.883714] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 1282.883714] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 20/48 resources of Type:Security Group Rules [ 1282.883788] env[65306]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: b8dc2b13-0f06-4660-ab7d-a65578892823 with Priority: HIGH for action security_group_rules [ 1282.883833] env[65306]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 57bb6fe9-98c4-47f0-9daa-c424a0c9dfee with Priority: HIGH for action security_group_rules [ 1282.883889] env[65306]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 9e80329d-1fcd-4c50-8991-a90e2a1fbdbc with Priority: HIGH for action security_group_rules [ 1282.883949] env[65306]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d with Priority: HIGH for action security_group_rules [ 1282.884043] env[65306]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: ac1808f0-d4d0-423f-abd5-9612116e67ac with Priority: HIGH for action security_group_rules [ 1282.884114] env[65306]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 331be455-1cf8-4667-8d43-bd7a51712610 with Priority: HIGH for action security_group_rules [ 1282.884178] env[65306]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 0cb41b0f-cdd2-4222-95b4-bafd614b7460 with Priority: HIGH for action security_group_rules [ 1282.884224] env[65306]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 50a889c1-6336-4320-94ea-df1e6eaa778c with Priority: HIGH for action security_group_rules [ 1282.884283] env[65306]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 1dfcba8d-33df-4f0e-919e-4904bde851ad with Priority: HIGH for action security_group_rules [ 1282.884356] env[65306]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: f2738afc-1df7-4958-9efd-71a6bbe54e6e with Priority: HIGH for action security_group_rules [ 1282.884423] env[65306]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 979b0e99-7f65-434d-a9e9-1ff018f5b499 with Priority: HIGH for action security_group_rules [ 1282.884489] env[65306]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 37349b8b-c2c1-4141-8b10-752c27492cbd with Priority: HIGH for action security_group_rules [ 1282.884541] env[65306]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 24148ee6-c16b-47cd-97f7-9716f2d1e6b4 with Priority: HIGH for action security_group_rules [ 1282.884613] env[65306]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: e84d3263-5312-46e3-9331-fbbe9b6a7e85 with Priority: HIGH for action security_group_rules [ 1282.884677] env[65306]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: e21f899c-0473-418d-9b8f-8591e9dc160f with Priority: HIGH for action security_group_rules [ 1282.884740] env[65306]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 9672ecd6-e064-4287-b1ae-4b673c86ae96 with Priority: HIGH for action security_group_rules [ 1282.884811] env[65306]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 7c868cfd-e55d-4976-95db-5b3f64c76a5f with Priority: HIGH for action security_group_rules [ 1282.884877] env[65306]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 1b97992b-9002-4b6e-b809-d68f93354c99 with Priority: HIGH for action security_group_rules [ 1282.884943] env[65306]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 3eee5457-701b-405e-bdf2-f055e0150d49 with Priority: HIGH for action security_group_rules [ 1282.885018] env[65306]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: b9d469db-f694-4408-9c06-70ff03328f59 with Priority: HIGH for action security_group_rules [ 1282.885127] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1283.397462] env[65306]: INFO networking_nsxv3.common.synchronization [req-70afa200-2a39-431d-ac35-92339c5ddb74 req-de79a46a-78a2-4b3a-8ff5-57a1d397e746 tempest-AttachVolumeNegativeTest-723798471 tempest-AttachVolumeNegativeTest-723798471-project-member] Enqueued Resource ID: ac1808f0-d4d0-423f-abd5-9612116e67ac with Priority: HIGHEST for action security_group_members [ 1283.398026] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ac1808f0-d4d0-423f-abd5-9612116e67ac with Priority: HIGHEST for action security_group_members [ 1283.398179] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b8dc2b13-0f06-4660-ab7d-a65578892823 with Priority: HIGH for action security_group_rules [ 1283.398288] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9e80329d-1fcd-4c50-8991-a90e2a1fbdbc with Priority: HIGH for action security_group_rules [ 1283.398389] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0cb41b0f-cdd2-4222-95b4-bafd614b7460 with Priority: HIGH for action security_group_rules [ 1283.398488] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e21f899c-0473-418d-9b8f-8591e9dc160f with Priority: HIGH for action security_group_rules [ 1283.398583] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b9d469db-f694-4408-9c06-70ff03328f59 with Priority: HIGH for action security_group_rules [ 1283.398767] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3eee5457-701b-405e-bdf2-f055e0150d49 with Priority: HIGH for action security_group_rules [ 1283.398767] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1b97992b-9002-4b6e-b809-d68f93354c99 with Priority: HIGH for action security_group_rules [ 1283.398905] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7c868cfd-e55d-4976-95db-5b3f64c76a5f with Priority: HIGH for action security_group_rules [ 1283.398944] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e84d3263-5312-46e3-9331-fbbe9b6a7e85 with Priority: HIGH for action security_group_rules [ 1283.399024] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9672ecd6-e064-4287-b1ae-4b673c86ae96 with Priority: HIGH for action security_group_rules [ 1283.399120] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 24148ee6-c16b-47cd-97f7-9716f2d1e6b4 with Priority: HIGH for action security_group_rules [ 1283.399210] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 37349b8b-c2c1-4141-8b10-752c27492cbd with Priority: HIGH for action security_group_rules [ 1283.399299] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 979b0e99-7f65-434d-a9e9-1ff018f5b499 with Priority: HIGH for action security_group_rules [ 1283.399605] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f2738afc-1df7-4958-9efd-71a6bbe54e6e with Priority: HIGH for action security_group_rules [ 1283.399605] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1dfcba8d-33df-4f0e-919e-4904bde851ad with Priority: HIGH for action security_group_rules [ 1283.399605] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 331be455-1cf8-4667-8d43-bd7a51712610 with Priority: HIGH for action security_group_rules [ 1283.399792] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 50a889c1-6336-4320-94ea-df1e6eaa778c with Priority: HIGH for action security_group_rules [ 1283.399792] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ac1808f0-d4d0-423f-abd5-9612116e67ac with Priority: HIGH for action security_group_rules [ 1283.399916] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 57bb6fe9-98c4-47f0-9daa-c424a0c9dfee with Priority: HIGH for action security_group_rules [ 1283.399916] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d with Priority: HIGH for action security_group_rules [ 1283.400199] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-ac1808f0-d4d0-423f-abd5-9612116e67ac taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1283.400391] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ac1808f0-d4d0-423f-abd5-9612116e67ac" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1283.400391] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ac1808f0-d4d0-423f-abd5-9612116e67ac" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1283.400586] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ac1808f0-d4d0-423f-abd5-9612116e67ac" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1283.401362] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1283.401479] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1283.401554] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1283.401689] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1283.401775] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1283.401870] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ac1808f0-d4d0-423f-abd5-9612116e67ac',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1283.402729] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b8dc2b13-0f06-4660-ab7d-a65578892823 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1283.403117] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b8dc2b13-0f06-4660-ab7d-a65578892823" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1283.403117] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b8dc2b13-0f06-4660-ab7d-a65578892823" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1283.403117] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b8dc2b13-0f06-4660-ab7d-a65578892823" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1283.403117] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b8dc2b13-0f06-4660-ab7d-a65578892823',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1283.403894] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9e80329d-1fcd-4c50-8991-a90e2a1fbdbc taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1283.404875] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9e80329d-1fcd-4c50-8991-a90e2a1fbdbc" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1283.404875] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9e80329d-1fcd-4c50-8991-a90e2a1fbdbc" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1283.404875] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9e80329d-1fcd-4c50-8991-a90e2a1fbdbc" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1283.404875] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9e80329d-1fcd-4c50-8991-a90e2a1fbdbc',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1283.405119] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0cb41b0f-cdd2-4222-95b4-bafd614b7460 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1283.405119] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0cb41b0f-cdd2-4222-95b4-bafd614b7460" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1283.405119] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0cb41b0f-cdd2-4222-95b4-bafd614b7460" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1283.405462] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0cb41b0f-cdd2-4222-95b4-bafd614b7460" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1283.405462] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0cb41b0f-cdd2-4222-95b4-bafd614b7460',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1283.406039] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e21f899c-0473-418d-9b8f-8591e9dc160f taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1283.406170] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e21f899c-0473-418d-9b8f-8591e9dc160f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1283.406170] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e21f899c-0473-418d-9b8f-8591e9dc160f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1283.406329] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e21f899c-0473-418d-9b8f-8591e9dc160f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1283.406404] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e21f899c-0473-418d-9b8f-8591e9dc160f',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1283.407218] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b9d469db-f694-4408-9c06-70ff03328f59 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1283.407351] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b9d469db-f694-4408-9c06-70ff03328f59" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1283.407415] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b9d469db-f694-4408-9c06-70ff03328f59" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1283.407527] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b9d469db-f694-4408-9c06-70ff03328f59" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1283.407590] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b9d469db-f694-4408-9c06-70ff03328f59',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1283.408293] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3eee5457-701b-405e-bdf2-f055e0150d49 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1283.408394] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3eee5457-701b-405e-bdf2-f055e0150d49" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1283.408471] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3eee5457-701b-405e-bdf2-f055e0150d49" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1283.408606] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3eee5457-701b-405e-bdf2-f055e0150d49" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1283.408676] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3eee5457-701b-405e-bdf2-f055e0150d49',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1283.409387] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1b97992b-9002-4b6e-b809-d68f93354c99 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1283.409831] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1b97992b-9002-4b6e-b809-d68f93354c99" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1283.409831] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1b97992b-9002-4b6e-b809-d68f93354c99" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1283.409831] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1b97992b-9002-4b6e-b809-d68f93354c99" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1283.409831] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1b97992b-9002-4b6e-b809-d68f93354c99',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1283.410771] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7c868cfd-e55d-4976-95db-5b3f64c76a5f taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1283.410771] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7c868cfd-e55d-4976-95db-5b3f64c76a5f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1283.410771] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7c868cfd-e55d-4976-95db-5b3f64c76a5f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1283.410976] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7c868cfd-e55d-4976-95db-5b3f64c76a5f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1283.410976] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7c868cfd-e55d-4976-95db-5b3f64c76a5f',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1283.411935] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e84d3263-5312-46e3-9331-fbbe9b6a7e85 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1283.411935] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e84d3263-5312-46e3-9331-fbbe9b6a7e85" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1283.411935] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e84d3263-5312-46e3-9331-fbbe9b6a7e85" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1283.411935] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e84d3263-5312-46e3-9331-fbbe9b6a7e85" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1283.411935] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e84d3263-5312-46e3-9331-fbbe9b6a7e85',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1283.412609] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9672ecd6-e064-4287-b1ae-4b673c86ae96 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1283.412716] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9672ecd6-e064-4287-b1ae-4b673c86ae96" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1283.412781] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9672ecd6-e064-4287-b1ae-4b673c86ae96" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1283.413249] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9672ecd6-e064-4287-b1ae-4b673c86ae96" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1283.413249] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9672ecd6-e064-4287-b1ae-4b673c86ae96',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1283.413701] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock rules-24148ee6-c16b-47cd-97f7-9716f2d1e6b4 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1283.413848] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-24148ee6-c16b-47cd-97f7-9716f2d1e6b4" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1283.413918] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-24148ee6-c16b-47cd-97f7-9716f2d1e6b4" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1283.414053] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-24148ee6-c16b-47cd-97f7-9716f2d1e6b4" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1283.414141] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('24148ee6-c16b-47cd-97f7-9716f2d1e6b4',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1283.414882] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock rules-37349b8b-c2c1-4141-8b10-752c27492cbd taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1283.414982] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-37349b8b-c2c1-4141-8b10-752c27492cbd" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1283.415059] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-37349b8b-c2c1-4141-8b10-752c27492cbd" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1283.415205] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-37349b8b-c2c1-4141-8b10-752c27492cbd" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1283.415274] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('37349b8b-c2c1-4141-8b10-752c27492cbd',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1283.415959] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock rules-979b0e99-7f65-434d-a9e9-1ff018f5b499 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1283.416071] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-979b0e99-7f65-434d-a9e9-1ff018f5b499" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1283.416140] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-979b0e99-7f65-434d-a9e9-1ff018f5b499" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1283.416278] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-979b0e99-7f65-434d-a9e9-1ff018f5b499" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1283.416417] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('979b0e99-7f65-434d-a9e9-1ff018f5b499',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1283.417784] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f2738afc-1df7-4958-9efd-71a6bbe54e6e taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1283.417784] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f2738afc-1df7-4958-9efd-71a6bbe54e6e" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1283.417784] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f2738afc-1df7-4958-9efd-71a6bbe54e6e" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1283.417784] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f2738afc-1df7-4958-9efd-71a6bbe54e6e" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1283.417784] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f2738afc-1df7-4958-9efd-71a6bbe54e6e',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1283.418280] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1dfcba8d-33df-4f0e-919e-4904bde851ad taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1283.418446] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1dfcba8d-33df-4f0e-919e-4904bde851ad" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1283.418446] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1dfcba8d-33df-4f0e-919e-4904bde851ad" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1283.418594] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1dfcba8d-33df-4f0e-919e-4904bde851ad" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1283.418778] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1dfcba8d-33df-4f0e-919e-4904bde851ad',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1283.419532] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock rules-331be455-1cf8-4667-8d43-bd7a51712610 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1283.419682] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-331be455-1cf8-4667-8d43-bd7a51712610" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1283.419737] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-331be455-1cf8-4667-8d43-bd7a51712610" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1283.419851] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-331be455-1cf8-4667-8d43-bd7a51712610" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1283.419908] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('331be455-1cf8-4667-8d43-bd7a51712610',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1283.420806] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock rules-50a889c1-6336-4320-94ea-df1e6eaa778c taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1283.420806] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-50a889c1-6336-4320-94ea-df1e6eaa778c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1283.420806] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-50a889c1-6336-4320-94ea-df1e6eaa778c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1283.420968] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-50a889c1-6336-4320-94ea-df1e6eaa778c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1283.420968] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('50a889c1-6336-4320-94ea-df1e6eaa778c',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1283.421605] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ac1808f0-d4d0-423f-abd5-9612116e67ac taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1283.421712] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ac1808f0-d4d0-423f-abd5-9612116e67ac" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1283.421777] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ac1808f0-d4d0-423f-abd5-9612116e67ac" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1283.421917] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ac1808f0-d4d0-423f-abd5-9612116e67ac" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1283.421989] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ac1808f0-d4d0-423f-abd5-9612116e67ac',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1283.422868] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock rules-57bb6fe9-98c4-47f0-9daa-c424a0c9dfee taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1283.422978] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-57bb6fe9-98c4-47f0-9daa-c424a0c9dfee" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1283.423065] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-57bb6fe9-98c4-47f0-9daa-c424a0c9dfee" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1283.423197] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-57bb6fe9-98c4-47f0-9daa-c424a0c9dfee" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1283.423269] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('57bb6fe9-98c4-47f0-9daa-c424a0c9dfee',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1283.424296] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock rules-60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1283.424423] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1283.424475] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1283.424738] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1283.424815] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1283.448375] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1283.448515] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1283.448687] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1283.448796] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1283.476021] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1283.476154] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1b97992b-9002-4b6e-b809-d68f93354c99 is going to be deleted. [ 1283.535502] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1283.535502] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1283.535502] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1283.535726] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1283.535726] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1283.535810] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1b97992b-9002-4b6e-b809-d68f93354c99" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1283.929084] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-b8dc2b13-0f06-4660-ab7d-a65578892823 taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1283.929084] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b8dc2b13-0f06-4660-ab7d-a65578892823" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1283.929084] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b8dc2b13-0f06-4660-ab7d-a65578892823" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1283.929084] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b8dc2b13-0f06-4660-ab7d-a65578892823" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1283.929084] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1283.929084] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1283.929084] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1283.929084] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1283.929572] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1283.929572] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b8dc2b13-0f06-4660-ab7d-a65578892823" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1283.929572] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b8dc2b13-0f06-4660-ab7d-a65578892823',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1283.934320] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1283.934456] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1283.934555] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1283.934767] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1283.940800] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-24148ee6-c16b-47cd-97f7-9716f2d1e6b4 taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1283.941077] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-24148ee6-c16b-47cd-97f7-9716f2d1e6b4" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1283.941077] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-24148ee6-c16b-47cd-97f7-9716f2d1e6b4" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1283.941204] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-24148ee6-c16b-47cd-97f7-9716f2d1e6b4" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1283.941316] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1283.941425] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1283.941425] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1283.941593] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1283.941669] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1283.941763] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-24148ee6-c16b-47cd-97f7-9716f2d1e6b4" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1283.941855] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('24148ee6-c16b-47cd-97f7-9716f2d1e6b4',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1283.944750] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-e84d3263-5312-46e3-9331-fbbe9b6a7e85 taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1283.944849] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e84d3263-5312-46e3-9331-fbbe9b6a7e85" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1283.944906] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e84d3263-5312-46e3-9331-fbbe9b6a7e85" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1283.945057] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e84d3263-5312-46e3-9331-fbbe9b6a7e85" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1283.945250] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1283.945379] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1283.945455] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1283.945581] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1283.945672] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1283.945752] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e84d3263-5312-46e3-9331-fbbe9b6a7e85" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1283.945830] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e84d3263-5312-46e3-9331-fbbe9b6a7e85',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1283.951193] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1283.951304] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1283.951371] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1283.951539] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1283.951688] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1283.951785] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1283.951850] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1283.951984] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1283.952079] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1283.952179] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1283.952250] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1283.961610] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('24148ee6-c16b-47cd-97f7-9716f2d1e6b4',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1283.969853] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1283.970038] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1283.970177] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1283.970389] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1283.970577] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1283.970683] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1283.970750] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1283.970921] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1283.971039] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1283.971131] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1283.971340] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1283.971447] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1283.971537] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1283.971701] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1283.971873] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1283.971975] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1283.972044] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1283.972202] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1283.972284] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1283.972388] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1283.972498] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1284.018137] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1284.018332] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1284.019542] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1284.019693] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1284.027969] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1284.028172] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1284.028626] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1284.028740] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1284.029569] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1284.029781] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1284.029894] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1284.029961] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1284.030176] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1284.030262] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1284.030355] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ac1808f0-d4d0-423f-abd5-9612116e67ac is going to be updated. [ 1284.031923] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1284.032030] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1284.032104] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1284.032280] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1284.033824] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1284.033911] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1284.034609] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1284.034697] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1284.035394] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1284.035481] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1284.036323] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1284.036441] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1284.038289] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1284.038427] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1284.039204] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1284.039311] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1284.039959] env[65306]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1284.040528] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1284.040528] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1284.041182] env[65306]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1284.041554] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1284.041662] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1284.043954] env[65306]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1284.044389] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1284.044481] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1284.069802] env[65306]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1284.070453] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1284.070453] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b9d469db-f694-4408-9c06-70ff03328f59 is going to be deleted. [ 1284.071456] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1284.071671] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1284.073255] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1284.073362] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1284.116061] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1284.116352] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 979b0e99-7f65-434d-a9e9-1ff018f5b499 is going to be deleted. [ 1284.117379] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1284.117583] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1284.121765] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1284.121765] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1284.121927] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1284.122014] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1284.122178] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1284.134626] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ac1808f0-d4d0-423f-abd5-9612116e67ac in Status: IN_PROGRESS for 2s [ 1284.140303] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1284.140444] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9e80329d-1fcd-4c50-8991-a90e2a1fbdbc is going to be deleted. [ 1284.141753] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1284.141976] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1284.143886] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1284.143886] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1284.162667] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1284.162817] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0cb41b0f-cdd2-4222-95b4-bafd614b7460 is going to be deleted. [ 1284.163785] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1284.164007] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1284.188716] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1284.188881] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1284.189823] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1284.189823] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3eee5457-701b-405e-bdf2-f055e0150d49 is going to be deleted. [ 1284.190683] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1284.190896] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1284.202666] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1284.202794] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1284.215927] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1284.216151] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 331be455-1cf8-4667-8d43-bd7a51712610 is going to be deleted. [ 1284.217146] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1284.217262] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1284.259563] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1284.259806] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1284.311036] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1284.311036] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 37349b8b-c2c1-4141-8b10-752c27492cbd is going to be deleted. [ 1284.311935] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1284.312266] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1284.341883] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1284.341883] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f2738afc-1df7-4958-9efd-71a6bbe54e6e is going to be deleted. [ 1284.342431] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1284.342652] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1284.387937] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1284.388251] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1284.433959] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1284.434170] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e21f899c-0473-418d-9b8f-8591e9dc160f is going to be deleted. [ 1284.435254] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1284.435508] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1284.437121] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1284.437225] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1284.437496] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-b8dc2b13-0f06-4660-ab7d-a65578892823 taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1284.437600] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b8dc2b13-0f06-4660-ab7d-a65578892823" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1284.437669] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b8dc2b13-0f06-4660-ab7d-a65578892823" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1284.437842] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b8dc2b13-0f06-4660-ab7d-a65578892823" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1284.438041] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1284.438168] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1284.438248] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1284.438425] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1284.438526] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1284.438627] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b8dc2b13-0f06-4660-ab7d-a65578892823" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1284.438794] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-b8dc2b13-0f06-4660-ab7d-a65578892823 taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1284.438896] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b8dc2b13-0f06-4660-ab7d-a65578892823" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1284.438970] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b8dc2b13-0f06-4660-ab7d-a65578892823" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1284.439164] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b8dc2b13-0f06-4660-ab7d-a65578892823" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1284.439359] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1284.439473] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1284.439548] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1284.439722] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1284.439830] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1284.439981] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b8dc2b13-0f06-4660-ab7d-a65578892823" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1284.440125] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b8dc2b13-0f06-4660-ab7d-a65578892823',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1284.458976] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e84d3263-5312-46e3-9331-fbbe9b6a7e85',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1284.469169] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 24148ee6-c16b-47cd-97f7-9716f2d1e6b4: rpc.has_security_group_logging(os_id): False [ 1284.494065] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1284.494065] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1284.494065] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d: rpc.has_security_group_logging(os_id): False [ 1284.496695] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1284.496835] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9672ecd6-e064-4287-b1ae-4b673c86ae96 is going to be deleted. [ 1284.497662] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1284.497934] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1284.539225] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1284.539355] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1284.590734] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1284.590851] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1284.591718] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1284.591817] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1284.594297] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1284.594415] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7c868cfd-e55d-4976-95db-5b3f64c76a5f is going to be deleted. [ 1284.595346] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1284.595564] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1284.634834] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1284.635045] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1284.675749] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1284.676081] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 57bb6fe9-98c4-47f0-9daa-c424a0c9dfee is going to be deleted. [ 1284.677386] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1284.677727] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1284.677883] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1284.678038] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ac1808f0-d4d0-423f-abd5-9612116e67ac is going to be deleted. [ 1284.679199] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1284.679489] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1284.726608] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1284.726803] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1dfcba8d-33df-4f0e-919e-4904bde851ad is going to be deleted. [ 1284.727854] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1284.728128] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1284.763919] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1284.764184] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1284.774583] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1284.774806] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1284.792829] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1284.793031] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 50a889c1-6336-4320-94ea-df1e6eaa778c is going to be deleted. [ 1284.794189] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1284.794429] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1284.794541] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1284.794692] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b9d469db-f694-4408-9c06-70ff03328f59" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1284.794891] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1284.795094] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1284.795180] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1284.795321] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-979b0e99-7f65-434d-a9e9-1ff018f5b499" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1284.796016] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1284.796293] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1284.796398] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1284.796655] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9e80329d-1fcd-4c50-8991-a90e2a1fbdbc" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1284.796818] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1284.796973] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1284.797079] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1284.797196] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0cb41b0f-cdd2-4222-95b4-bafd614b7460" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1284.797330] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1284.797474] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1284.797549] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1284.797675] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3eee5457-701b-405e-bdf2-f055e0150d49" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1284.797832] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1284.797979] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1284.798070] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1284.798185] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-331be455-1cf8-4667-8d43-bd7a51712610" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1284.798312] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1284.798452] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1284.798525] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1284.798637] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-37349b8b-c2c1-4141-8b10-752c27492cbd" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1284.798759] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1284.798942] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1284.808943] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1284.809145] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1284.869516] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1284.869964] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1284.870104] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1284.870180] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1284.870410] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1284.870505] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1284.870664] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 24148ee6-c16b-47cd-97f7-9716f2d1e6b4 is going to be updated. [ 1284.871990] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1284.872228] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1284.872323] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1284.872492] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f2738afc-1df7-4958-9efd-71a6bbe54e6e" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1284.872655] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1284.872857] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1284.874564] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1284.874685] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1284.942102] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b8dc2b13-0f06-4660-ab7d-a65578892823: rpc.has_security_group_logging(os_id): False [ 1284.946336] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1284.946635] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1284.946887] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1284.946986] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1284.947162] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1284.947247] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1284.947468] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1284.947557] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1284.947631] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1284.947770] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1284.947845] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1284.948044] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1284.948126] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1284.948192] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1284.948322] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1284.948398] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1284.948498] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d is going to be updated. [ 1284.949527] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1284.949696] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1284.949782] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1284.949904] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9672ecd6-e064-4287-b1ae-4b673c86ae96" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1284.950053] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1284.950199] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1284.950280] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1284.950439] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7c868cfd-e55d-4976-95db-5b3f64c76a5f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1284.951199] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1284.951335] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1284.951435] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1284.951603] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1284.951686] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1284.951807] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-50a889c1-6336-4320-94ea-df1e6eaa778c" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1284.952472] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1284.952560] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1284.952628] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1284.952778] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1284.952856] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1284.952960] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1dfcba8d-33df-4f0e-919e-4904bde851ad" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1284.953104] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1284.953250] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1284.953324] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1284.953428] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ac1808f0-d4d0-423f-abd5-9612116e67ac" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1284.953546] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1284.953683] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1284.953747] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1284.953856] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-57bb6fe9-98c4-47f0-9daa-c424a0c9dfee" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1284.954380] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1284.954533] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1284.954614] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1284.954792] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e21f899c-0473-418d-9b8f-8591e9dc160f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1284.961261] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e84d3263-5312-46e3-9331-fbbe9b6a7e85: rpc.has_security_group_logging(os_id): False [ 1285.002926] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1285.003186] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1285.003304] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1285.003604] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1285.009211] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1285.009446] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1285.059713] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1285.060018] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1285.060152] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1285.060222] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1285.060428] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1285.060530] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1285.060712] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1285.060816] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1285.061038] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1285.061038] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1285.061121] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1285.061287] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1285.061362] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1285.061426] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1285.061566] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1285.061673] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1285.061779] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b8dc2b13-0f06-4660-ab7d-a65578892823 is going to be updated. [ 1285.062826] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1285.062989] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1285.188193] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1285.188420] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1285.191712] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1285.191911] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1285.205239] env[65306]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1285.205821] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1285.206154] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1285.206335] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1285.206335] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1285.206518] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1285.206617] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1285.206760] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e84d3263-5312-46e3-9331-fbbe9b6a7e85 is going to be updated. [ 1285.208113] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1285.208313] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1285.208462] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1285.210659] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1285.210941] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1285.211161] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1285.237070] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 24148ee6-c16b-47cd-97f7-9716f2d1e6b4 in Status: IN_PROGRESS for 2s [ 1285.342896] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d in Status: IN_PROGRESS for 2s [ 1285.358880] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1285.359103] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1285.359178] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1285.359425] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1285.359580] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1285.395185] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b8dc2b13-0f06-4660-ab7d-a65578892823 in Status: IN_PROGRESS for 2s [ 1285.410252] env[65306]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1285.410832] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1285.410966] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1285.411051] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1285.411291] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1285.411553] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1285.433591] env[65306]: INFO networking_nsxv3.common.synchronization [req-43a5ed81-3d5c-46ff-83ee-c54e6e4eb03a req-856f1b3d-0d79-4c49-96b4-cd3478c8cb05 tempest-ServerRescueNegativeTestJSON-1491097463 tempest-ServerRescueNegativeTestJSON-1491097463-project-member] Enqueued Resource ID: b8dc2b13-0f06-4660-ab7d-a65578892823 with Priority: HIGHEST for action security_group_members [ 1285.434360] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b8dc2b13-0f06-4660-ab7d-a65578892823 with Priority: HIGHEST for action security_group_members [ 1285.435272] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-b8dc2b13-0f06-4660-ab7d-a65578892823 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1285.435476] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b8dc2b13-0f06-4660-ab7d-a65578892823" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1285.435611] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b8dc2b13-0f06-4660-ab7d-a65578892823" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1285.436060] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b8dc2b13-0f06-4660-ab7d-a65578892823" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1285.436125] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1285.436242] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1285.436311] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1285.436481] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1285.436567] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1285.436693] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b8dc2b13-0f06-4660-ab7d-a65578892823',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1285.459897] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e84d3263-5312-46e3-9331-fbbe9b6a7e85 in Status: IN_PROGRESS for 2s [ 1285.938803] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1285.938940] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1285.939164] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1285.939406] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1285.939545] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1285.939867] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1285.940014] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1285.940088] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1285.940282] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1285.940397] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1285.940520] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b8dc2b13-0f06-4660-ab7d-a65578892823 is going to be updated. [ 1285.992555] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1285.992725] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1285.992859] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1285.993196] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1285.993447] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1286.004372] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b8dc2b13-0f06-4660-ab7d-a65578892823 in Status: IN_PROGRESS for 2s [ 1286.145456] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ac1808f0-d4d0-423f-abd5-9612116e67ac in Status: SUCCESS [ 1286.145802] env[65306]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ac1808f0-d4d0-423f-abd5-9612116e67ac deletion is rescheduled due to dependency. [ 1286.146020] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ac1808f0-d4d0-423f-abd5-9612116e67ac" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1286.177397] env[65306]: INFO networking_nsxv3.common.synchronization [req-b5b5dcd7-cfbb-49e3-b4aa-44d807c8b723 req-59b89626-d1d4-4363-8a88-1e8bfbe57e6b tempest-ServerActionsTestJSON-437813836 tempest-ServerActionsTestJSON-437813836-project-member] Enqueued Resource ID: 6e403189-fcac-40e3-aa50-4c17f4d29895 with Priority: HIGHEST for action security_group_members [ 1286.178190] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6e403189-fcac-40e3-aa50-4c17f4d29895 with Priority: HIGHEST for action security_group_members [ 1286.178717] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-6e403189-fcac-40e3-aa50-4c17f4d29895 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1286.178835] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6e403189-fcac-40e3-aa50-4c17f4d29895" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1286.178944] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6e403189-fcac-40e3-aa50-4c17f4d29895" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1286.179242] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6e403189-fcac-40e3-aa50-4c17f4d29895" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1286.179468] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1286.179620] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1286.179725] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1286.179954] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1286.180107] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1286.180249] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6e403189-fcac-40e3-aa50-4c17f4d29895',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1286.684307] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1286.684630] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1286.684630] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1286.684713] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1286.704928] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1286.705215] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1286.705338] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1286.705422] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1286.705649] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1286.705811] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1286.705915] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6e403189-fcac-40e3-aa50-4c17f4d29895 is going to be updated. [ 1286.733078] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1286.733241] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1286.733303] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1286.733515] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1286.733816] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1286.743078] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6e403189-fcac-40e3-aa50-4c17f4d29895 in Status: IN_PROGRESS for 2s [ 1287.251032] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 24148ee6-c16b-47cd-97f7-9716f2d1e6b4 in Status: SUCCESS [ 1287.252027] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-24148ee6-c16b-47cd-97f7-9716f2d1e6b4" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1287.362212] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d in Status: SUCCESS [ 1287.362333] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1287.410890] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b8dc2b13-0f06-4660-ab7d-a65578892823 in Status: SUCCESS [ 1287.411126] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b8dc2b13-0f06-4660-ab7d-a65578892823" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1287.474594] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e84d3263-5312-46e3-9331-fbbe9b6a7e85 in Status: SUCCESS [ 1287.474869] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e84d3263-5312-46e3-9331-fbbe9b6a7e85" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1288.015276] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b8dc2b13-0f06-4660-ab7d-a65578892823 in Status: SUCCESS [ 1288.015577] env[65306]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b8dc2b13-0f06-4660-ab7d-a65578892823 deletion is rescheduled due to dependency. [ 1288.015577] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b8dc2b13-0f06-4660-ab7d-a65578892823" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1288.755213] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6e403189-fcac-40e3-aa50-4c17f4d29895 in Status: SUCCESS [ 1288.755422] env[65306]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6e403189-fcac-40e3-aa50-4c17f4d29895 deletion is rescheduled due to dependency. [ 1288.755531] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6e403189-fcac-40e3-aa50-4c17f4d29895" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1289.415482] env[65306]: INFO networking_nsxv3.common.synchronization [req-c02e2d23-aa17-4c1f-a4bc-4dc331f73da1 req-ae108e9a-969a-4b72-bbec-309fb7cc7882 tempest-AttachInterfacesTestJSON-144464476 tempest-AttachInterfacesTestJSON-144464476-project-member] Enqueued Resource ID: a70508b0-bb5b-4d0d-af41-b80fbdcfe90e with Priority: HIGHEST for action security_group_members [ 1289.416133] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a70508b0-bb5b-4d0d-af41-b80fbdcfe90e with Priority: HIGHEST for action security_group_members [ 1289.416614] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-a70508b0-bb5b-4d0d-af41-b80fbdcfe90e taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1289.416614] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a70508b0-bb5b-4d0d-af41-b80fbdcfe90e" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1289.416614] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a70508b0-bb5b-4d0d-af41-b80fbdcfe90e" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1289.416850] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a70508b0-bb5b-4d0d-af41-b80fbdcfe90e" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1289.416891] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1289.417058] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1289.417058] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1289.417205] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1289.417309] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1289.417927] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a70508b0-bb5b-4d0d-af41-b80fbdcfe90e',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1289.920173] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a70508b0-bb5b-4d0d-af41-b80fbdcfe90e',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1290.423827] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a70508b0-bb5b-4d0d-af41-b80fbdcfe90e',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1290.926033] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1290.926243] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1290.926243] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1290.926435] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1290.926526] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1290.926638] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a70508b0-bb5b-4d0d-af41-b80fbdcfe90e is going to be updated. [ 1290.961043] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1290.961043] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1290.961424] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1290.961424] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1290.961511] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1290.970598] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a70508b0-bb5b-4d0d-af41-b80fbdcfe90e in Status: IN_PROGRESS for 2s [ 1292.981775] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a70508b0-bb5b-4d0d-af41-b80fbdcfe90e in Status: SUCCESS [ 1292.982097] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a70508b0-bb5b-4d0d-af41-b80fbdcfe90e" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1294.417433] env[65306]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1294.417854] env[65306]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1295.380756] env[65306]: INFO networking_nsxv3.common.synchronization [None req-6c7c9876-d672-45aa-9fbd-7a478d87d472 None None] Enqueued Resource ID: 78c9632c-6b46-46be-9c13-76c6d51c2ec0 with Priority: HIGHEST for action port [ 1295.381716] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 78c9632c-6b46-46be-9c13-76c6d51c2ec0 with Priority: HIGHEST for action port [ 1295.382049] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock port-78c9632c-6b46-46be-9c13-76c6d51c2ec0 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1295.382190] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-78c9632c-6b46-46be-9c13-76c6d51c2ec0" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1295.382262] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-78c9632c-6b46-46be-9c13-76c6d51c2ec0" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1295.382530] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-78c9632c-6b46-46be-9c13-76c6d51c2ec0" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1295.382616] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('78c9632c-6b46-46be-9c13-76c6d51c2ec0',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1295.777355] env[65306]: INFO networking_nsxv3.common.synchronization [req-1f21e32f-ad3b-4af9-a332-22b2ad8743ab req-bfe0863a-edef-4793-8139-81bfffc3c1d3 tempest-AttachInterfacesTestJSON-144464476 tempest-AttachInterfacesTestJSON-144464476-project-member] Enqueued Resource ID: a70508b0-bb5b-4d0d-af41-b80fbdcfe90e with Priority: HIGHEST for action security_group_members [ 1295.777839] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a70508b0-bb5b-4d0d-af41-b80fbdcfe90e with Priority: HIGHEST for action security_group_members [ 1295.778199] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-a70508b0-bb5b-4d0d-af41-b80fbdcfe90e taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1295.778324] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a70508b0-bb5b-4d0d-af41-b80fbdcfe90e" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1295.778383] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a70508b0-bb5b-4d0d-af41-b80fbdcfe90e" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1295.778603] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a70508b0-bb5b-4d0d-af41-b80fbdcfe90e" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1295.778769] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1295.778936] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1295.778936] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1295.779332] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1295.779332] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1295.779332] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a70508b0-bb5b-4d0d-af41-b80fbdcfe90e',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1295.884798] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 78c9632c-6b46-46be-9c13-76c6d51c2ec0 [ 1295.885123] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1295.885263] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1295.885339] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1295.885556] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1295.885650] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1295.885861] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:78c9632c-6b46-46be-9c13-76c6d51c2ec0 already deleted. [ 1295.885904] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-78c9632c-6b46-46be-9c13-76c6d51c2ec0" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1296.282609] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1296.282851] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1296.282958] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1296.283256] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1296.307587] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1296.307888] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1296.308021] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1296.308132] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1296.308349] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1296.308462] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1296.308557] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a70508b0-bb5b-4d0d-af41-b80fbdcfe90e is going to be updated. [ 1296.336338] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1296.336476] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1296.336552] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1296.336762] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1296.336911] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1296.346388] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a70508b0-bb5b-4d0d-af41-b80fbdcfe90e in Status: IN_PROGRESS for 2s [ 1297.513467] env[65306]: INFO networking_nsxv3.common.synchronization [None req-a8399175-4eca-4647-b55b-5adb572864b9 None None] Enqueued Resource ID: 50fea444-7433-437c-8c46-0a3e97780090 with Priority: HIGHEST for action port [ 1297.514667] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 50fea444-7433-437c-8c46-0a3e97780090 with Priority: HIGHEST for action port [ 1297.514667] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock port-50fea444-7433-437c-8c46-0a3e97780090 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1297.514667] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-50fea444-7433-437c-8c46-0a3e97780090" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1297.514667] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-50fea444-7433-437c-8c46-0a3e97780090" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1297.514851] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-50fea444-7433-437c-8c46-0a3e97780090" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1297.514851] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('50fea444-7433-437c-8c46-0a3e97780090',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1298.017078] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 50fea444-7433-437c-8c46-0a3e97780090 [ 1298.017344] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1298.017714] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1298.017714] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1298.017866] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1298.017866] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1298.017935] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:50fea444-7433-437c-8c46-0a3e97780090 already deleted. [ 1298.018016] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-50fea444-7433-437c-8c46-0a3e97780090" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1298.358594] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a70508b0-bb5b-4d0d-af41-b80fbdcfe90e in Status: SUCCESS [ 1298.358858] env[65306]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a70508b0-bb5b-4d0d-af41-b80fbdcfe90e deletion is rescheduled due to dependency. [ 1298.358858] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a70508b0-bb5b-4d0d-af41-b80fbdcfe90e" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.238661] env[65306]: INFO networking_nsxv3.common.synchronization [None req-cdc20ea2-237c-41be-b7e5-5f9d3a18651d tempest-AttachInterfacesTestJSON-144464476 tempest-AttachInterfacesTestJSON-144464476-project-member] Enqueued Resource ID: 60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d with Priority: HIGHEST for action security_group_members [ 1300.239207] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d with Priority: HIGHEST for action security_group_members [ 1300.239549] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.239860] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.239860] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.239980] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.240247] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.240351] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.240416] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.240567] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.240653] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.240757] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1300.742391] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.742620] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.742620] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.742918] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.743051] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.743281] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.743385] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.743519] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.743691] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.743796] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.743908] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d is going to be updated. [ 1300.777824] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.778063] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.778063] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.778250] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.778391] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.786649] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d in Status: IN_PROGRESS for 2s [ 1301.930014] env[65306]: INFO networking_nsxv3.common.synchronization [req-8bd8aa39-f8bd-439b-b815-11001e69ae2a req-a71eba8f-cc8a-4238-a846-ac40d0846d9d tempest-ServerRescueTestJSON-1113721572 tempest-ServerRescueTestJSON-1113721572-project-member] Enqueued Resource ID: 77ce039f-cf05-4e5a-9730-79ab5552fd3f with Priority: HIGHEST for action security_group_members [ 1301.930014] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 77ce039f-cf05-4e5a-9730-79ab5552fd3f with Priority: HIGHEST for action security_group_members [ 1301.930014] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-77ce039f-cf05-4e5a-9730-79ab5552fd3f taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1301.930420] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-77ce039f-cf05-4e5a-9730-79ab5552fd3f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1301.930420] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-77ce039f-cf05-4e5a-9730-79ab5552fd3f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1301.930420] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-77ce039f-cf05-4e5a-9730-79ab5552fd3f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1301.930519] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1301.930593] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1301.930655] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1301.930942] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1301.930942] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.931060] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('77ce039f-cf05-4e5a-9730-79ab5552fd3f',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1302.270569] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock network-846 taken with stack trace [, , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1302.270700] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "network-846" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1302.270790] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "network-846" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1302.271117] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "network-846" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1302.271377] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1302.271532] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1302.271650] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1302.271865] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1302.272013] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1302.272228] env[65306]: DEBUG dogpile.cache.region [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] No value present for key: 'zone-id' {{(pid=65306) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1302.272389] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] NeedRegenerationException {{(pid=65306) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1302.272438] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] no value, waiting for create lock {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1302.272538] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] value creation lock acquired {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1302.272643] env[65306]: DEBUG dogpile.cache.region [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] No value present for key: 'zone-id' {{(pid=65306) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1302.272743] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Calling creation function for not-yet-present value {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1302.272912] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1302.292670] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1302.292965] env[65306]: DEBUG dogpile.cache.region [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65306) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1302.292965] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Released creation lock {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1302.293153] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "network-846" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1302.293914] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock port-ef4a7504-0b69-48b9-8b0c-fd1a5829d7b2 taken with stack trace [, , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1302.293914] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "port-ef4a7504-0b69-48b9-8b0c-fd1a5829d7b2" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1302.293914] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "port-ef4a7504-0b69-48b9-8b0c-fd1a5829d7b2" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1302.294144] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "port-ef4a7504-0b69-48b9-8b0c-fd1a5829d7b2" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1302.294179] env[65306]: DEBUG networking_nsxv3.api.rpc [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ef4a7504-0b69-48b9-8b0c-fd1a5829d7b2',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1302.433397] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1302.433617] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1302.433617] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1302.433848] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1302.433957] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1302.434179] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1302.434291] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1302.434355] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1302.434507] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1302.434584] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1302.434670] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 77ce039f-cf05-4e5a-9730-79ab5552fd3f already deleted. [ 1302.434749] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-77ce039f-cf05-4e5a-9730-79ab5552fd3f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1302.797009] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d in Status: SUCCESS [ 1302.797244] env[65306]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d deletion is rescheduled due to dependency. [ 1302.797344] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1302.797829] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1302.798090] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1302.798226] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1302.798486] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1302.798628] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1302.798775] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Segment Port ef4a7504-0b69-48b9-8b0c-fd1a5829d7b2 not found, creating... [ 1302.799041] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1302.799205] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1302.799321] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1302.799542] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1302.799676] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1302.799951] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1302.800121] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1302.800251] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1302.800454] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1302.800585] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1302.800722] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Resource: SegmentPort with ID: ef4a7504-0b69-48b9-8b0c-fd1a5829d7b2 is going to be created. [ 1302.820242] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1302.820466] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1302.820561] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1302.820835] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1302.821087] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1302.821318] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "port-ef4a7504-0b69-48b9-8b0c-fd1a5829d7b2" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1303.543872] env[65306]: INFO networking_nsxv3.common.synchronization [req-8bd8aa39-f8bd-439b-b815-11001e69ae2a req-f46a9bfa-e9e5-40ea-be69-ee36d25796e5 service nova] Enqueued Resource ID: 77ce039f-cf05-4e5a-9730-79ab5552fd3f with Priority: HIGHEST for action security_group_rules [ 1303.544299] env[65306]: INFO networking_nsxv3.common.synchronization [req-8bd8aa39-f8bd-439b-b815-11001e69ae2a req-f46a9bfa-e9e5-40ea-be69-ee36d25796e5 service nova] Enqueued Resource ID: 77ce039f-cf05-4e5a-9730-79ab5552fd3f with Priority: HIGHEST for action security_group_members [ 1303.544568] env[65306]: INFO networking_nsxv3.common.synchronization [req-8bd8aa39-f8bd-439b-b815-11001e69ae2a req-f46a9bfa-e9e5-40ea-be69-ee36d25796e5 service nova] Enqueued Resource ID: ef4a7504-0b69-48b9-8b0c-fd1a5829d7b2 with Priority: HIGHEST for action port [ 1303.545500] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 77ce039f-cf05-4e5a-9730-79ab5552fd3f with Priority: HIGHEST for action security_group_rules [ 1303.546095] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 77ce039f-cf05-4e5a-9730-79ab5552fd3f with Priority: HIGHEST for action security_group_members [ 1303.546095] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ef4a7504-0b69-48b9-8b0c-fd1a5829d7b2 with Priority: HIGHEST for action port [ 1303.546410] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock rules-77ce039f-cf05-4e5a-9730-79ab5552fd3f taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.546617] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-77ce039f-cf05-4e5a-9730-79ab5552fd3f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.546788] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-77ce039f-cf05-4e5a-9730-79ab5552fd3f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1303.547630] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-77ce039f-cf05-4e5a-9730-79ab5552fd3f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1303.547630] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('77ce039f-cf05-4e5a-9730-79ab5552fd3f',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1303.549169] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-77ce039f-cf05-4e5a-9730-79ab5552fd3f taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.549380] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-77ce039f-cf05-4e5a-9730-79ab5552fd3f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.549522] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-77ce039f-cf05-4e5a-9730-79ab5552fd3f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1303.550126] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-77ce039f-cf05-4e5a-9730-79ab5552fd3f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1303.550126] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.550320] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.550455] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1303.550740] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1303.550933] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1303.551209] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('77ce039f-cf05-4e5a-9730-79ab5552fd3f',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1303.552477] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock port-ef4a7504-0b69-48b9-8b0c-fd1a5829d7b2 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.552676] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ef4a7504-0b69-48b9-8b0c-fd1a5829d7b2" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.552833] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ef4a7504-0b69-48b9-8b0c-fd1a5829d7b2" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1303.553235] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ef4a7504-0b69-48b9-8b0c-fd1a5829d7b2" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1303.553363] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ef4a7504-0b69-48b9-8b0c-fd1a5829d7b2',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1304.055929] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-77ce039f-cf05-4e5a-9730-79ab5552fd3f taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.056131] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-77ce039f-cf05-4e5a-9730-79ab5552fd3f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.056394] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('77ce039f-cf05-4e5a-9730-79ab5552fd3f',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1304.057754] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ef4a7504-0b69-48b9-8b0c-fd1a5829d7b2 with status ACTIVE [ 1304.058018] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.058277] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.058376] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.058584] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.058714] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.058912] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.059027] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.059091] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.059254] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.059363] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.059556] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.059677] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.059767] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.059895] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.059993] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.060095] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ef4a7504-0b69-48b9-8b0c-fd1a5829d7b2 is going to be updated. [ 1304.081469] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.081656] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.081656] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.081844] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.081995] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.082174] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ef4a7504-0b69-48b9-8b0c-fd1a5829d7b2" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.562311] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('77ce039f-cf05-4e5a-9730-79ab5552fd3f',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1305.064814] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.065092] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.065092] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.065277] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.065374] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.065481] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 77ce039f-cf05-4e5a-9730-79ab5552fd3f is going to be created. [ 1305.089352] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.089565] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.089565] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.089747] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.089904] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.099114] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 77ce039f-cf05-4e5a-9730-79ab5552fd3f in Status: UNINITIALIZED for 2s [ 1307.110908] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 77ce039f-cf05-4e5a-9730-79ab5552fd3f in Status: SUCCESS [ 1307.110908] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-77ce039f-cf05-4e5a-9730-79ab5552fd3f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.111178] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-77ce039f-cf05-4e5a-9730-79ab5552fd3f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.111178] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-77ce039f-cf05-4e5a-9730-79ab5552fd3f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.111379] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.111498] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1307.111567] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.111718] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.111799] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.111886] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-77ce039f-cf05-4e5a-9730-79ab5552fd3f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.111977] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('77ce039f-cf05-4e5a-9730-79ab5552fd3f',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1307.614665] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-77ce039f-cf05-4e5a-9730-79ab5552fd3f taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.614880] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-77ce039f-cf05-4e5a-9730-79ab5552fd3f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1307.614880] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-77ce039f-cf05-4e5a-9730-79ab5552fd3f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.615106] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-77ce039f-cf05-4e5a-9730-79ab5552fd3f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.615313] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.615421] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1307.615487] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.616071] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.616071] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.616071] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-77ce039f-cf05-4e5a-9730-79ab5552fd3f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.616071] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-77ce039f-cf05-4e5a-9730-79ab5552fd3f taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.616326] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-77ce039f-cf05-4e5a-9730-79ab5552fd3f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1307.616326] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-77ce039f-cf05-4e5a-9730-79ab5552fd3f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.616326] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-77ce039f-cf05-4e5a-9730-79ab5552fd3f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.616493] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.616542] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1307.616610] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.616801] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.616894] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.616983] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-77ce039f-cf05-4e5a-9730-79ab5552fd3f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.617090] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('77ce039f-cf05-4e5a-9730-79ab5552fd3f',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1308.119784] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 77ce039f-cf05-4e5a-9730-79ab5552fd3f: rpc.has_security_group_logging(os_id): False [ 1308.141313] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1308.141543] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1308.141543] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1308.141680] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1308.141768] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1308.141961] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1308.142074] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1308.142136] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1308.142295] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1308.142372] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1308.142575] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1308.142673] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1308.142737] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1308.142881] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1308.142957] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1308.143152] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1308.143247] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1308.143309] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1308.143449] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1308.143524] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1308.143610] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 77ce039f-cf05-4e5a-9730-79ab5552fd3f is going to be created. [ 1308.232503] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1308.232776] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1308.232776] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1308.232930] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1308.233129] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1308.345067] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 77ce039f-cf05-4e5a-9730-79ab5552fd3f in Status: IN_PROGRESS for 2s [ 1308.546795] env[65306]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1308.547044] env[65306]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1310.359726] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 77ce039f-cf05-4e5a-9730-79ab5552fd3f in Status: SUCCESS [ 1310.360127] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-77ce039f-cf05-4e5a-9730-79ab5552fd3f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1313.548435] env[65306]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1313.548818] env[65306]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1313.961883] env[65306]: INFO networking_nsxv3.common.synchronization [req-d5c3b451-38c6-41df-9dc5-214a5e715177 req-865a452c-2a4c-4257-b695-0ace6529049f tempest-AttachVolumeShelveTestJSON-1351401733 tempest-AttachVolumeShelveTestJSON-1351401733-project-member] Enqueued Resource ID: e84d3263-5312-46e3-9331-fbbe9b6a7e85 with Priority: HIGHEST for action security_group_members [ 1313.962033] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e84d3263-5312-46e3-9331-fbbe9b6a7e85 with Priority: HIGHEST for action security_group_members [ 1313.962352] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-e84d3263-5312-46e3-9331-fbbe9b6a7e85 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1313.962472] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e84d3263-5312-46e3-9331-fbbe9b6a7e85" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1313.962540] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e84d3263-5312-46e3-9331-fbbe9b6a7e85" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1313.962730] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e84d3263-5312-46e3-9331-fbbe9b6a7e85" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1313.962903] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1313.963056] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1313.963162] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1313.963353] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1313.963467] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1313.963584] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e84d3263-5312-46e3-9331-fbbe9b6a7e85',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1314.465585] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1314.465758] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1314.465832] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1314.466178] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1314.466277] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1314.466482] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1314.466575] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1314.466659] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1314.466819] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1314.466898] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1314.466989] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e84d3263-5312-46e3-9331-fbbe9b6a7e85 is going to be updated. [ 1314.496767] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1314.496967] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1314.496967] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1314.497191] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1314.497332] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1314.505831] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e84d3263-5312-46e3-9331-fbbe9b6a7e85 in Status: IN_PROGRESS for 2s [ 1316.518468] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e84d3263-5312-46e3-9331-fbbe9b6a7e85 in Status: SUCCESS [ 1316.518834] env[65306]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e84d3263-5312-46e3-9331-fbbe9b6a7e85 deletion is rescheduled due to dependency. [ 1316.518834] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e84d3263-5312-46e3-9331-fbbe9b6a7e85" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1318.962944] env[65306]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1318.963218] env[65306]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1323.859380] env[65306]: INFO networking_nsxv3.common.synchronization [req-e5238547-8c36-4c40-9264-567f7e33c683 req-41efd134-9559-4ccf-853a-f52c64c99caf tempest-ServerRescueTestJSON-1113721572 tempest-ServerRescueTestJSON-1113721572-project-member] Enqueued Resource ID: 77ce039f-cf05-4e5a-9730-79ab5552fd3f with Priority: HIGHEST for action security_group_members [ 1323.859955] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 77ce039f-cf05-4e5a-9730-79ab5552fd3f with Priority: HIGHEST for action security_group_members [ 1323.860288] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-77ce039f-cf05-4e5a-9730-79ab5552fd3f taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1323.860420] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-77ce039f-cf05-4e5a-9730-79ab5552fd3f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1323.860490] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-77ce039f-cf05-4e5a-9730-79ab5552fd3f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1323.860783] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-77ce039f-cf05-4e5a-9730-79ab5552fd3f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1323.860946] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1323.862157] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1323.862157] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1323.862157] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1323.862157] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1323.862157] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('77ce039f-cf05-4e5a-9730-79ab5552fd3f',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1324.221980] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock network-846 taken with stack trace [, , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1324.222230] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "network-846" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1324.222419] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "network-846" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1324.222681] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "network-846" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1324.222978] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1324.223183] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1324.223329] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1324.223587] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1324.223749] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1324.223988] env[65306]: DEBUG dogpile.cache.region [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] No value present for key: 'zone-id' {{(pid=65306) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1324.224133] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] NeedRegenerationException {{(pid=65306) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1324.224279] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] no value, waiting for create lock {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1324.224544] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] value creation lock acquired {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1324.224639] env[65306]: DEBUG dogpile.cache.region [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] No value present for key: 'zone-id' {{(pid=65306) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1324.224682] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Calling creation function for not-yet-present value {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1324.224796] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1324.246830] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1324.247048] env[65306]: DEBUG dogpile.cache.region [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65306) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1324.247169] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Released creation lock {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1324.247339] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "network-846" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1324.247656] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock port-00df9a5c-1bfb-4f4a-a0bb-e951a471c528 taken with stack trace [, , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1324.247824] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "port-00df9a5c-1bfb-4f4a-a0bb-e951a471c528" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1324.247939] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "port-00df9a5c-1bfb-4f4a-a0bb-e951a471c528" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1324.248624] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "port-00df9a5c-1bfb-4f4a-a0bb-e951a471c528" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1324.248624] env[65306]: DEBUG networking_nsxv3.api.rpc [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('00df9a5c-1bfb-4f4a-a0bb-e951a471c528',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1324.363027] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('77ce039f-cf05-4e5a-9730-79ab5552fd3f',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1324.751618] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1324.751846] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1324.751947] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1324.752258] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1324.752411] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1324.752567] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Segment Port 00df9a5c-1bfb-4f4a-a0bb-e951a471c528 not found, creating... [ 1324.752816] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1324.752971] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1324.753102] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1324.753329] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1324.753458] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1324.753733] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1324.753903] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1324.754161] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1324.754440] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1324.754580] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1324.754724] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Resource: SegmentPort with ID: 00df9a5c-1bfb-4f4a-a0bb-e951a471c528 is going to be created. [ 1324.774320] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1324.774545] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1324.774621] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1324.774875] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1324.775114] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1324.775337] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "port-00df9a5c-1bfb-4f4a-a0bb-e951a471c528" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1324.865482] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('77ce039f-cf05-4e5a-9730-79ab5552fd3f',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1325.368242] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1325.368409] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1325.368489] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1325.368690] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1325.368823] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1325.368900] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 77ce039f-cf05-4e5a-9730-79ab5552fd3f is going to be updated. [ 1325.399695] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1325.399840] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1325.399914] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1325.400137] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1325.400288] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1325.412036] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 77ce039f-cf05-4e5a-9730-79ab5552fd3f in Status: IN_PROGRESS for 2s [ 1325.474022] env[65306]: INFO networking_nsxv3.common.synchronization [req-e5238547-8c36-4c40-9264-567f7e33c683 req-c3621c47-8664-4f09-9864-007fba6690d2 service nova] Enqueued Resource ID: 77ce039f-cf05-4e5a-9730-79ab5552fd3f with Priority: HIGHEST for action security_group_rules [ 1325.474022] env[65306]: INFO networking_nsxv3.common.synchronization [req-e5238547-8c36-4c40-9264-567f7e33c683 req-c3621c47-8664-4f09-9864-007fba6690d2 service nova] Enqueued Resource ID: 77ce039f-cf05-4e5a-9730-79ab5552fd3f with Priority: HIGHEST for action security_group_members [ 1325.474022] env[65306]: INFO networking_nsxv3.common.synchronization [req-e5238547-8c36-4c40-9264-567f7e33c683 req-c3621c47-8664-4f09-9864-007fba6690d2 service nova] Enqueued Resource ID: 00df9a5c-1bfb-4f4a-a0bb-e951a471c528 with Priority: HIGHEST for action port [ 1325.474493] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 77ce039f-cf05-4e5a-9730-79ab5552fd3f with Priority: HIGHEST for action security_group_rules [ 1325.474626] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 77ce039f-cf05-4e5a-9730-79ab5552fd3f with Priority: HIGHEST for action security_group_members [ 1325.474722] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00df9a5c-1bfb-4f4a-a0bb-e951a471c528 with Priority: HIGHEST for action port [ 1325.474997] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock rules-77ce039f-cf05-4e5a-9730-79ab5552fd3f taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1325.478244] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-77ce039f-cf05-4e5a-9730-79ab5552fd3f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1325.478244] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-77ce039f-cf05-4e5a-9730-79ab5552fd3f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1325.478368] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-77ce039f-cf05-4e5a-9730-79ab5552fd3f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1325.478415] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('77ce039f-cf05-4e5a-9730-79ab5552fd3f',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1325.479949] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-77ce039f-cf05-4e5a-9730-79ab5552fd3f taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1325.480075] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-77ce039f-cf05-4e5a-9730-79ab5552fd3f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1325.480329] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock port-00df9a5c-1bfb-4f4a-a0bb-e951a471c528 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1325.480440] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-00df9a5c-1bfb-4f4a-a0bb-e951a471c528" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1325.480493] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-00df9a5c-1bfb-4f4a-a0bb-e951a471c528" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1325.480683] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-00df9a5c-1bfb-4f4a-a0bb-e951a471c528" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1325.480761] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('00df9a5c-1bfb-4f4a-a0bb-e951a471c528',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1325.982963] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-77ce039f-cf05-4e5a-9730-79ab5552fd3f taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1325.983491] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-77ce039f-cf05-4e5a-9730-79ab5552fd3f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1325.983491] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 00df9a5c-1bfb-4f4a-a0bb-e951a471c528 with status ACTIVE [ 1325.983620] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1325.983730] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1325.983730] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1325.983983] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1325.984088] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1325.984243] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1325.984348] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1325.984431] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1325.984621] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1325.984725] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1325.984888] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1325.984978] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1325.985057] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1325.985204] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1325.985281] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1325.985376] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 00df9a5c-1bfb-4f4a-a0bb-e951a471c528 is going to be updated. [ 1326.006512] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1326.006750] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1326.006750] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1326.006947] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1326.007129] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1326.007330] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-00df9a5c-1bfb-4f4a-a0bb-e951a471c528" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1327.422737] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 77ce039f-cf05-4e5a-9730-79ab5552fd3f in Status: SUCCESS [ 1327.423144] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-77ce039f-cf05-4e5a-9730-79ab5552fd3f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1327.423200] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-77ce039f-cf05-4e5a-9730-79ab5552fd3f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1327.423482] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-77ce039f-cf05-4e5a-9730-79ab5552fd3f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1327.423681] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1327.423800] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1327.423868] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1327.424034] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1327.424124] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1327.424223] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('77ce039f-cf05-4e5a-9730-79ab5552fd3f',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1327.926805] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('77ce039f-cf05-4e5a-9730-79ab5552fd3f',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1328.429574] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('77ce039f-cf05-4e5a-9730-79ab5552fd3f',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1328.932752] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1328.932978] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1328.932978] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1328.933174] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1328.933272] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1328.933375] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 77ce039f-cf05-4e5a-9730-79ab5552fd3f is going to be updated. [ 1328.961558] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1328.961779] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1328.961779] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1328.961956] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1328.962121] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1328.971089] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 77ce039f-cf05-4e5a-9730-79ab5552fd3f in Status: IN_PROGRESS for 2s [ 1330.475836] env[65306]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1330.475836] env[65306]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 1330.984949] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 77ce039f-cf05-4e5a-9730-79ab5552fd3f in Status: SUCCESS [ 1330.985201] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-77ce039f-cf05-4e5a-9730-79ab5552fd3f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1330.985389] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-77ce039f-cf05-4e5a-9730-79ab5552fd3f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1330.985608] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-77ce039f-cf05-4e5a-9730-79ab5552fd3f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1330.985802] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1330.985922] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1330.985990] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1330.986230] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1330.986318] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1330.986406] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-77ce039f-cf05-4e5a-9730-79ab5552fd3f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1330.986499] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('77ce039f-cf05-4e5a-9730-79ab5552fd3f',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1331.488864] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-77ce039f-cf05-4e5a-9730-79ab5552fd3f taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1331.489364] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-77ce039f-cf05-4e5a-9730-79ab5552fd3f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1331.489364] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-77ce039f-cf05-4e5a-9730-79ab5552fd3f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1331.489541] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-77ce039f-cf05-4e5a-9730-79ab5552fd3f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1331.489783] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1331.489940] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1331.490087] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1331.490269] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1331.490402] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1331.490537] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-77ce039f-cf05-4e5a-9730-79ab5552fd3f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1331.490744] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-77ce039f-cf05-4e5a-9730-79ab5552fd3f taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1331.490873] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-77ce039f-cf05-4e5a-9730-79ab5552fd3f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1331.490960] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-77ce039f-cf05-4e5a-9730-79ab5552fd3f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1331.491164] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-77ce039f-cf05-4e5a-9730-79ab5552fd3f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1331.491350] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1331.491474] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1331.491560] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1331.491742] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1331.491844] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1331.491954] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-77ce039f-cf05-4e5a-9730-79ab5552fd3f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1331.492090] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('77ce039f-cf05-4e5a-9730-79ab5552fd3f',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1331.994325] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 77ce039f-cf05-4e5a-9730-79ab5552fd3f: rpc.has_security_group_logging(os_id): False [ 1332.013734] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1332.013959] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1332.014032] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1332.014282] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1332.014371] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1332.014573] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1332.014671] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1332.014726] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1332.014880] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1332.014956] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1332.015169] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1332.015264] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1332.015324] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1332.015474] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1332.015549] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1332.015722] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1332.015815] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1332.015869] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1332.016014] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1332.016092] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1332.016194] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 77ce039f-cf05-4e5a-9730-79ab5552fd3f is going to be updated. [ 1332.076015] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1332.076267] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1332.076325] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1332.076539] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1332.076695] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1332.089431] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 77ce039f-cf05-4e5a-9730-79ab5552fd3f in Status: IN_PROGRESS for 2s [ 1334.104670] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 77ce039f-cf05-4e5a-9730-79ab5552fd3f in Status: SUCCESS [ 1334.105109] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-77ce039f-cf05-4e5a-9730-79ab5552fd3f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1335.477475] env[65306]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1335.477937] env[65306]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1340.478283] env[65306]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1340.478732] env[65306]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1345.478876] env[65306]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1345.479361] env[65306]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1348.673265] env[65306]: INFO networking_nsxv3.common.synchronization [req-a82ae32f-f2e3-4916-8f25-71ec10a49468 req-4ade2bfd-9a7f-422c-b2ff-65ab5da278ba tempest-ServerRescueTestJSON-1113721572 tempest-ServerRescueTestJSON-1113721572-project-member] Enqueued Resource ID: 77ce039f-cf05-4e5a-9730-79ab5552fd3f with Priority: HIGHEST for action security_group_members [ 1348.673843] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 77ce039f-cf05-4e5a-9730-79ab5552fd3f with Priority: HIGHEST for action security_group_members [ 1348.674229] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-77ce039f-cf05-4e5a-9730-79ab5552fd3f taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1348.674377] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-77ce039f-cf05-4e5a-9730-79ab5552fd3f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1348.674475] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-77ce039f-cf05-4e5a-9730-79ab5552fd3f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1348.674703] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-77ce039f-cf05-4e5a-9730-79ab5552fd3f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1348.674880] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1348.675012] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1348.675110] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1348.675292] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1348.675403] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1348.675521] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('77ce039f-cf05-4e5a-9730-79ab5552fd3f',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1349.177642] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('77ce039f-cf05-4e5a-9730-79ab5552fd3f',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1349.679849] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('77ce039f-cf05-4e5a-9730-79ab5552fd3f',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1350.182293] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1350.182533] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1350.182533] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1350.182734] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1350.182829] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1350.182931] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 77ce039f-cf05-4e5a-9730-79ab5552fd3f is going to be updated. [ 1350.212284] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1350.212482] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1350.212482] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1350.212695] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1350.212852] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1350.221764] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 77ce039f-cf05-4e5a-9730-79ab5552fd3f in Status: IN_PROGRESS for 2s [ 1352.233969] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 77ce039f-cf05-4e5a-9730-79ab5552fd3f in Status: SUCCESS [ 1352.234396] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-77ce039f-cf05-4e5a-9730-79ab5552fd3f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1353.675069] env[65306]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1353.675428] env[65306]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1355.267843] env[65306]: INFO networking_nsxv3.common.synchronization [req-59ee8fff-d55c-44d3-9ba5-454eaab95fc7 req-c851d156-efec-4b1b-8b2b-212f698ddd1b tempest-ServerRescueTestJSON-1113721572 tempest-ServerRescueTestJSON-1113721572-project-member] Enqueued Resource ID: 77ce039f-cf05-4e5a-9730-79ab5552fd3f with Priority: HIGHEST for action security_group_members [ 1355.268434] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 77ce039f-cf05-4e5a-9730-79ab5552fd3f with Priority: HIGHEST for action security_group_members [ 1355.268763] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-77ce039f-cf05-4e5a-9730-79ab5552fd3f taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1355.268900] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-77ce039f-cf05-4e5a-9730-79ab5552fd3f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1355.268987] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-77ce039f-cf05-4e5a-9730-79ab5552fd3f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1355.269440] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-77ce039f-cf05-4e5a-9730-79ab5552fd3f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1355.269440] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1355.269605] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1355.269605] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1355.269682] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1355.269757] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1355.269849] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('77ce039f-cf05-4e5a-9730-79ab5552fd3f',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1355.774372] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1355.774612] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1355.774612] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1355.774807] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1355.774911] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1355.775128] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1355.775231] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1355.775297] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1355.775455] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1355.775533] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1355.775620] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 77ce039f-cf05-4e5a-9730-79ab5552fd3f is going to be updated. [ 1355.805166] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1355.805368] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1355.805368] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1355.805604] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1355.805720] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1355.814848] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 77ce039f-cf05-4e5a-9730-79ab5552fd3f in Status: IN_PROGRESS for 2s [ 1357.827275] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 77ce039f-cf05-4e5a-9730-79ab5552fd3f in Status: SUCCESS [ 1357.827737] env[65306]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 77ce039f-cf05-4e5a-9730-79ab5552fd3f deletion is rescheduled due to dependency. [ 1357.827737] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-77ce039f-cf05-4e5a-9730-79ab5552fd3f" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1360.269612] env[65306]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1360.269612] env[65306]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1365.270994] env[65306]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1365.270994] env[65306]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1368.005360] env[65306]: INFO networking_nsxv3.common.synchronization [req-95fd5d4c-fb40-468f-8a9f-20d4b06c31cc req-5579663e-1b6d-4030-94a5-70b43f914d1f tempest-ServerActionsTestOtherA-65612913 tempest-ServerActionsTestOtherA-65612913-project-member] Enqueued Resource ID: 24148ee6-c16b-47cd-97f7-9716f2d1e6b4 with Priority: HIGHEST for action security_group_members [ 1368.005928] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 24148ee6-c16b-47cd-97f7-9716f2d1e6b4 with Priority: HIGHEST for action security_group_members [ 1368.006256] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-24148ee6-c16b-47cd-97f7-9716f2d1e6b4 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1368.006384] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-24148ee6-c16b-47cd-97f7-9716f2d1e6b4" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1368.006453] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-24148ee6-c16b-47cd-97f7-9716f2d1e6b4" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1368.006685] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-24148ee6-c16b-47cd-97f7-9716f2d1e6b4" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1368.006835] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1368.006959] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1368.007046] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1368.007773] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1368.007773] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1368.007773] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('24148ee6-c16b-47cd-97f7-9716f2d1e6b4',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1368.509831] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1368.510104] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1368.510223] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1368.510556] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1368.510704] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1368.511017] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1368.511184] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1368.511289] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1368.511524] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1368.511650] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1368.511790] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 24148ee6-c16b-47cd-97f7-9716f2d1e6b4 is going to be updated. [ 1368.545996] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1368.546247] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1368.546247] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1368.546430] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1368.546611] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1368.556244] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 24148ee6-c16b-47cd-97f7-9716f2d1e6b4 in Status: IN_PROGRESS for 2s [ 1370.566904] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 24148ee6-c16b-47cd-97f7-9716f2d1e6b4 in Status: SUCCESS [ 1370.567321] env[65306]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 24148ee6-c16b-47cd-97f7-9716f2d1e6b4 deletion is rescheduled due to dependency. [ 1370.567321] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-24148ee6-c16b-47cd-97f7-9716f2d1e6b4" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1373.006642] env[65306]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1373.006933] env[65306]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1377.590785] env[65306]: INFO networking_nsxv3.common.synchronization [req-074f2f09-16d6-4671-b6a7-467498d80470 req-990c860e-565c-467a-a85f-f43be53a7a8a tempest-ServerActionsTestOtherA-65612913 tempest-ServerActionsTestOtherA-65612913-project-member] Enqueued Resource ID: 2536346e-d62c-4c9f-a652-a4136cc7ff65 with Priority: HIGHEST for action security_group_members [ 1377.591309] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2536346e-d62c-4c9f-a652-a4136cc7ff65 with Priority: HIGHEST for action security_group_members [ 1377.591639] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-2536346e-d62c-4c9f-a652-a4136cc7ff65 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1377.591765] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2536346e-d62c-4c9f-a652-a4136cc7ff65" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1377.591830] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2536346e-d62c-4c9f-a652-a4136cc7ff65" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1377.592039] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2536346e-d62c-4c9f-a652-a4136cc7ff65" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1377.592195] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1377.592295] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1377.592352] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1377.592498] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1377.592583] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1377.592721] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2536346e-d62c-4c9f-a652-a4136cc7ff65',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1377.868071] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock network-435 taken with stack trace [, , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1377.868071] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "network-435" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1377.868340] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "network-435" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1377.868486] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "network-435" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1377.868746] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1377.868908] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1377.869037] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1377.869271] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1377.869416] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1377.869621] env[65306]: DEBUG dogpile.cache.region [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] No value present for key: 'zone-id' {{(pid=65306) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1377.869736] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] NeedRegenerationException {{(pid=65306) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1377.869846] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] no value, waiting for create lock {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1377.869955] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] value creation lock acquired {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1377.870075] env[65306]: DEBUG dogpile.cache.region [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] No value present for key: 'zone-id' {{(pid=65306) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1377.870185] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Calling creation function for not-yet-present value {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1377.870317] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1377.892390] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1377.892568] env[65306]: DEBUG dogpile.cache.region [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65306) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1377.892691] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Released creation lock {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1377.892870] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "network-435" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1377.893240] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock port-8c28642f-e1f4-4d06-92c4-0edd609f4549 taken with stack trace [, , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1377.893415] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "port-8c28642f-e1f4-4d06-92c4-0edd609f4549" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1377.893531] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "port-8c28642f-e1f4-4d06-92c4-0edd609f4549" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1377.893868] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "port-8c28642f-e1f4-4d06-92c4-0edd609f4549" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1377.894019] env[65306]: DEBUG networking_nsxv3.api.rpc [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8c28642f-e1f4-4d06-92c4-0edd609f4549',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1378.095454] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1378.095680] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1378.095680] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1378.095896] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1378.116936] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1378.117201] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1378.117324] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1378.117464] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1378.117637] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1378.117806] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1378.117806] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2536346e-d62c-4c9f-a652-a4136cc7ff65 is going to be updated. [ 1378.145314] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1378.145540] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1378.145627] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1378.145836] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1378.145983] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1378.155648] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2536346e-d62c-4c9f-a652-a4136cc7ff65 in Status: IN_PROGRESS for 2s [ 1378.396505] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1378.396758] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1378.396900] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1378.397224] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1378.397395] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1378.397556] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Segment Port 8c28642f-e1f4-4d06-92c4-0edd609f4549 not found, creating... [ 1378.397848] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1378.398028] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1378.398153] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1378.398384] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1378.398525] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1378.398815] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1378.398957] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1378.399091] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1378.399302] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1378.399435] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1378.399575] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Resource: SegmentPort with ID: 8c28642f-e1f4-4d06-92c4-0edd609f4549 is going to be created. [ 1378.422197] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1378.422468] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1378.422621] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1378.422877] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1378.423200] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1378.423468] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "port-8c28642f-e1f4-4d06-92c4-0edd609f4549" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1379.112367] env[65306]: INFO networking_nsxv3.common.synchronization [req-074f2f09-16d6-4671-b6a7-467498d80470 req-f58b5cba-7b80-434c-95ef-5e0ad9dab8c2 service nova] Enqueued Resource ID: 2536346e-d62c-4c9f-a652-a4136cc7ff65 with Priority: HIGHEST for action security_group_rules [ 1379.112659] env[65306]: INFO networking_nsxv3.common.synchronization [req-074f2f09-16d6-4671-b6a7-467498d80470 req-f58b5cba-7b80-434c-95ef-5e0ad9dab8c2 service nova] Enqueued Resource ID: 2536346e-d62c-4c9f-a652-a4136cc7ff65 with Priority: HIGHEST for action security_group_members [ 1379.112659] env[65306]: INFO networking_nsxv3.common.synchronization [req-074f2f09-16d6-4671-b6a7-467498d80470 req-f58b5cba-7b80-434c-95ef-5e0ad9dab8c2 service nova] Enqueued Resource ID: 8c28642f-e1f4-4d06-92c4-0edd609f4549 with Priority: HIGHEST for action port [ 1379.113064] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2536346e-d62c-4c9f-a652-a4136cc7ff65 with Priority: HIGHEST for action security_group_rules [ 1379.113200] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2536346e-d62c-4c9f-a652-a4136cc7ff65 with Priority: HIGHEST for action security_group_members [ 1379.113299] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8c28642f-e1f4-4d06-92c4-0edd609f4549 with Priority: HIGHEST for action port [ 1379.113569] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2536346e-d62c-4c9f-a652-a4136cc7ff65 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1379.113692] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2536346e-d62c-4c9f-a652-a4136cc7ff65" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1379.113761] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2536346e-d62c-4c9f-a652-a4136cc7ff65" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1379.113954] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2536346e-d62c-4c9f-a652-a4136cc7ff65" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1379.114050] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2536346e-d62c-4c9f-a652-a4136cc7ff65',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1379.115679] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-2536346e-d62c-4c9f-a652-a4136cc7ff65 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1379.115791] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2536346e-d62c-4c9f-a652-a4136cc7ff65" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1379.115993] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock port-8c28642f-e1f4-4d06-92c4-0edd609f4549 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1379.116127] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8c28642f-e1f4-4d06-92c4-0edd609f4549" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1379.116199] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8c28642f-e1f4-4d06-92c4-0edd609f4549" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1379.116369] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8c28642f-e1f4-4d06-92c4-0edd609f4549" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1379.116455] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8c28642f-e1f4-4d06-92c4-0edd609f4549',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1379.616797] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-2536346e-d62c-4c9f-a652-a4136cc7ff65 taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1379.616797] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2536346e-d62c-4c9f-a652-a4136cc7ff65" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1379.619828] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8c28642f-e1f4-4d06-92c4-0edd609f4549 with status ACTIVE [ 1379.619828] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1379.619828] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1379.619828] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1379.619828] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1379.619828] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1379.619828] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1379.619828] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1379.619828] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1379.619828] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1379.619828] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1379.619828] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1379.619828] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1379.619828] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1379.619828] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1379.620726] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1379.620726] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8c28642f-e1f4-4d06-92c4-0edd609f4549 is going to be updated. [ 1379.639755] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1379.640028] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1379.640028] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1379.640160] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1379.640298] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1379.640458] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8c28642f-e1f4-4d06-92c4-0edd609f4549" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1380.165865] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2536346e-d62c-4c9f-a652-a4136cc7ff65 in Status: SUCCESS [ 1380.167027] env[65306]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2536346e-d62c-4c9f-a652-a4136cc7ff65 deletion is rescheduled due to dependency. [ 1380.167126] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2536346e-d62c-4c9f-a652-a4136cc7ff65" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1380.167278] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2536346e-d62c-4c9f-a652-a4136cc7ff65" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1380.167492] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2536346e-d62c-4c9f-a652-a4136cc7ff65" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1380.167701] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1380.167815] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1380.167880] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1380.168055] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1380.168139] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1380.168234] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2536346e-d62c-4c9f-a652-a4136cc7ff65',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1380.670249] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2536346e-d62c-4c9f-a652-a4136cc7ff65',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1381.172809] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2536346e-d62c-4c9f-a652-a4136cc7ff65',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1381.675724] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1381.675724] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1381.675724] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1381.675724] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1381.675724] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1381.675724] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2536346e-d62c-4c9f-a652-a4136cc7ff65 is going to be updated. [ 1381.706164] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1381.706320] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1381.706392] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1381.706602] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1381.706790] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1381.715230] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2536346e-d62c-4c9f-a652-a4136cc7ff65 in Status: IN_PROGRESS for 2s [ 1383.726120] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2536346e-d62c-4c9f-a652-a4136cc7ff65 in Status: SUCCESS [ 1383.726120] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2536346e-d62c-4c9f-a652-a4136cc7ff65" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1383.726502] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2536346e-d62c-4c9f-a652-a4136cc7ff65" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1383.726502] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2536346e-d62c-4c9f-a652-a4136cc7ff65" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1383.726592] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1383.726727] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1383.726802] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1383.726954] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1383.727050] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1383.727137] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2536346e-d62c-4c9f-a652-a4136cc7ff65" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1383.727228] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2536346e-d62c-4c9f-a652-a4136cc7ff65',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1384.114392] env[65306]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1384.114587] env[65306]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1384.229282] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-2536346e-d62c-4c9f-a652-a4136cc7ff65 taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1384.229524] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2536346e-d62c-4c9f-a652-a4136cc7ff65" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1384.229633] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2536346e-d62c-4c9f-a652-a4136cc7ff65" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1384.229936] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2536346e-d62c-4c9f-a652-a4136cc7ff65" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1384.230159] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1384.230268] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1384.230338] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1384.230542] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1384.230650] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1384.230746] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2536346e-d62c-4c9f-a652-a4136cc7ff65" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1384.230922] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-2536346e-d62c-4c9f-a652-a4136cc7ff65 taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1384.231059] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2536346e-d62c-4c9f-a652-a4136cc7ff65" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1384.231152] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2536346e-d62c-4c9f-a652-a4136cc7ff65" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1384.231316] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2536346e-d62c-4c9f-a652-a4136cc7ff65" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1384.231461] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1384.231558] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1384.231623] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1384.231804] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1384.231905] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1384.232062] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2536346e-d62c-4c9f-a652-a4136cc7ff65" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1384.232212] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2536346e-d62c-4c9f-a652-a4136cc7ff65',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1384.734926] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2536346e-d62c-4c9f-a652-a4136cc7ff65: rpc.has_security_group_logging(os_id): False [ 1384.752603] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1384.752842] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1384.752842] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1384.752971] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1384.753049] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1384.753273] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1384.753370] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1384.753427] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1384.753583] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1384.753659] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1384.753841] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1384.753932] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1384.753992] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1384.754145] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1384.754220] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1384.754395] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1384.754488] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1384.754548] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1384.754686] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1384.754757] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1384.754841] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2536346e-d62c-4c9f-a652-a4136cc7ff65 is going to be updated. [ 1384.816611] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1384.816869] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1384.816869] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1384.817103] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1384.817255] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1384.852293] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2536346e-d62c-4c9f-a652-a4136cc7ff65 in Status: IN_PROGRESS for 2s [ 1386.452347] env[65306]: INFO networking_nsxv3.common.synchronization [req-4f78be3f-ca17-486c-ae20-5887be21faed req-9868eb9f-912b-4b41-8cb6-f867fe968f2a tempest-ServerActionsTestOtherA-65612913 tempest-ServerActionsTestOtherA-65612913-project-member] Enqueued Resource ID: 2536346e-d62c-4c9f-a652-a4136cc7ff65 with Priority: HIGHEST for action security_group_members [ 1386.452875] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2536346e-d62c-4c9f-a652-a4136cc7ff65 with Priority: HIGHEST for action security_group_members [ 1386.453214] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-2536346e-d62c-4c9f-a652-a4136cc7ff65 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1386.453407] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2536346e-d62c-4c9f-a652-a4136cc7ff65" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1386.453407] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2536346e-d62c-4c9f-a652-a4136cc7ff65" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1386.453600] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2536346e-d62c-4c9f-a652-a4136cc7ff65" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1386.453750] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1386.453908] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1386.453908] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1386.454059] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1386.454150] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1386.454246] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2536346e-d62c-4c9f-a652-a4136cc7ff65',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1386.496534] env[65306]: INFO networking_nsxv3.common.synchronization [req-4f78be3f-ca17-486c-ae20-5887be21faed req-9868eb9f-912b-4b41-8cb6-f867fe968f2a tempest-ServerActionsTestOtherA-65612913 tempest-ServerActionsTestOtherA-65612913-project-member] Enqueued Resource ID: 8c28642f-e1f4-4d06-92c4-0edd609f4549 with Priority: HIGHEST for action port [ 1386.497237] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8c28642f-e1f4-4d06-92c4-0edd609f4549 with Priority: HIGHEST for action port [ 1386.497547] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock port-8c28642f-e1f4-4d06-92c4-0edd609f4549 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1386.497670] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8c28642f-e1f4-4d06-92c4-0edd609f4549" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1386.497751] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8c28642f-e1f4-4d06-92c4-0edd609f4549" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1386.497974] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8c28642f-e1f4-4d06-92c4-0edd609f4549" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1386.498076] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8c28642f-e1f4-4d06-92c4-0edd609f4549',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1386.866398] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2536346e-d62c-4c9f-a652-a4136cc7ff65 in Status: SUCCESS [ 1386.866662] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2536346e-d62c-4c9f-a652-a4136cc7ff65" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1386.956795] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1386.956913] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1386.956987] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1386.957236] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1386.957332] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1386.957528] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1386.957630] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1386.957689] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1386.957848] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1386.957925] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1386.958015] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2536346e-d62c-4c9f-a652-a4136cc7ff65 is going to be updated. [ 1386.997190] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1386.997370] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1386.997415] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1386.997630] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1386.997826] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1386.999422] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8c28642f-e1f4-4d06-92c4-0edd609f4549 with status ACTIVE [ 1386.999623] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1386.999750] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1386.999840] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1387.000066] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1387.000156] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1387.000355] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1387.000461] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1387.000523] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1387.000677] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1387.000760] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1387.000945] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1387.001046] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1387.001111] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1387.001254] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1387.001337] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1387.001425] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8c28642f-e1f4-4d06-92c4-0edd609f4549 is going to be updated. [ 1387.010692] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2536346e-d62c-4c9f-a652-a4136cc7ff65 in Status: IN_PROGRESS for 2s [ 1387.064959] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1387.065149] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1387.065149] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1387.065541] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1387.065761] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1387.065980] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8c28642f-e1f4-4d06-92c4-0edd609f4549" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1389.023340] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2536346e-d62c-4c9f-a652-a4136cc7ff65 in Status: SUCCESS [ 1389.023732] env[65306]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2536346e-d62c-4c9f-a652-a4136cc7ff65 deletion is rescheduled due to dependency. [ 1389.023732] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2536346e-d62c-4c9f-a652-a4136cc7ff65" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1391.498403] env[65306]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1391.498869] env[65306]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1396.499619] env[65306]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1396.499995] env[65306]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1401.501238] env[65306]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1401.501698] env[65306]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1406.502487] env[65306]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1406.502865] env[65306]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1410.841082] env[65306]: INFO networking_nsxv3.common.synchronization [req-d7f56118-5b05-4c50-847f-cfd38a0fd47a req-0931b05d-ecf6-4574-99bb-06a7f9b863b7 tempest-ServerActionsTestOtherA-65612913 tempest-ServerActionsTestOtherA-65612913-project-member] Enqueued Resource ID: 3bf31731-6b75-4dfa-b76c-ee83bdf17eaa with Priority: HIGHEST for action security_group_members [ 1410.842049] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3bf31731-6b75-4dfa-b76c-ee83bdf17eaa with Priority: HIGHEST for action security_group_members [ 1410.842049] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-3bf31731-6b75-4dfa-b76c-ee83bdf17eaa taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1410.842231] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3bf31731-6b75-4dfa-b76c-ee83bdf17eaa" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1410.842231] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3bf31731-6b75-4dfa-b76c-ee83bdf17eaa" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1410.842434] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3bf31731-6b75-4dfa-b76c-ee83bdf17eaa" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1410.842656] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1410.842760] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1410.842827] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1410.842976] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1410.843113] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1410.843176] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3bf31731-6b75-4dfa-b76c-ee83bdf17eaa',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1411.091414] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock network-435 taken with stack trace [, , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1411.091610] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "network-435" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1411.091736] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "network-435" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1411.092015] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "network-435" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1411.092617] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1411.092791] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1411.092913] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1411.093218] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1411.093370] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1411.093639] env[65306]: DEBUG dogpile.cache.region [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] No value present for key: 'zone-id' {{(pid=65306) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1411.093762] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] NeedRegenerationException {{(pid=65306) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1411.093874] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] no value, waiting for create lock {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1411.093984] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] value creation lock acquired {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1411.094169] env[65306]: DEBUG dogpile.cache.region [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] No value present for key: 'zone-id' {{(pid=65306) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1411.094285] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Calling creation function for not-yet-present value {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1411.094423] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1411.114851] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1411.115087] env[65306]: DEBUG dogpile.cache.region [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65306) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1411.115207] env[65306]: DEBUG dogpile.lock [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Released creation lock {{(pid=65306) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1411.115372] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "network-435" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1411.115691] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock port-03284b4d-8a46-40a3-903e-883ed29a58b0 taken with stack trace [, , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1411.115863] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "port-03284b4d-8a46-40a3-903e-883ed29a58b0" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1411.115984] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "port-03284b4d-8a46-40a3-903e-883ed29a58b0" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1411.116325] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "port-03284b4d-8a46-40a3-903e-883ed29a58b0" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1411.116470] env[65306]: DEBUG networking_nsxv3.api.rpc [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('03284b4d-8a46-40a3-903e-883ed29a58b0',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1411.346286] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3bf31731-6b75-4dfa-b76c-ee83bdf17eaa',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1411.618448] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1411.618682] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1411.618790] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1411.619082] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1411.619239] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1411.619459] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Segment Port 03284b4d-8a46-40a3-903e-883ed29a58b0 not found, creating... [ 1411.620226] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1411.620428] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1411.620538] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1411.620785] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1411.620923] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1411.621275] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1411.621430] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1411.621547] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1411.621759] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1411.621893] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1411.622055] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Resource: SegmentPort with ID: 03284b4d-8a46-40a3-903e-883ed29a58b0 is going to be created. [ 1411.642029] env[65306]: DEBUG networking_nsxv3.common.locking [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1411.642029] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1411.642257] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1411.642438] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1411.642663] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1411.642876] env[65306]: DEBUG oslo_concurrency.lockutils [None req-94ee4cd6-779f-49d0-8bb2-29187efed648 None None] Releasing lock "port-03284b4d-8a46-40a3-903e-883ed29a58b0" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1411.848542] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3bf31731-6b75-4dfa-b76c-ee83bdf17eaa',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1412.325241] env[65306]: INFO networking_nsxv3.common.synchronization [req-d7f56118-5b05-4c50-847f-cfd38a0fd47a req-6244f23f-84a6-49ec-b89a-353060e547f1 service nova] Enqueued Resource ID: 3bf31731-6b75-4dfa-b76c-ee83bdf17eaa with Priority: HIGHEST for action security_group_rules [ 1412.325241] env[65306]: INFO networking_nsxv3.common.synchronization [req-d7f56118-5b05-4c50-847f-cfd38a0fd47a req-6244f23f-84a6-49ec-b89a-353060e547f1 service nova] Enqueued Resource ID: 3bf31731-6b75-4dfa-b76c-ee83bdf17eaa with Priority: HIGHEST for action security_group_members [ 1412.325241] env[65306]: INFO networking_nsxv3.common.synchronization [req-d7f56118-5b05-4c50-847f-cfd38a0fd47a req-6244f23f-84a6-49ec-b89a-353060e547f1 service nova] Enqueued Resource ID: 03284b4d-8a46-40a3-903e-883ed29a58b0 with Priority: HIGHEST for action port [ 1412.325241] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3bf31731-6b75-4dfa-b76c-ee83bdf17eaa with Priority: HIGHEST for action security_group_rules [ 1412.325241] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3bf31731-6b75-4dfa-b76c-ee83bdf17eaa with Priority: HIGHEST for action security_group_members [ 1412.325241] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 03284b4d-8a46-40a3-903e-883ed29a58b0 with Priority: HIGHEST for action port [ 1412.325241] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3bf31731-6b75-4dfa-b76c-ee83bdf17eaa taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1412.325241] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3bf31731-6b75-4dfa-b76c-ee83bdf17eaa" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1412.325241] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3bf31731-6b75-4dfa-b76c-ee83bdf17eaa" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1412.325883] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3bf31731-6b75-4dfa-b76c-ee83bdf17eaa" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1412.325883] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3bf31731-6b75-4dfa-b76c-ee83bdf17eaa',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1412.327333] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-3bf31731-6b75-4dfa-b76c-ee83bdf17eaa taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1412.327333] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3bf31731-6b75-4dfa-b76c-ee83bdf17eaa" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1412.327333] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock port-03284b4d-8a46-40a3-903e-883ed29a58b0 taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1412.327333] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-03284b4d-8a46-40a3-903e-883ed29a58b0" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1412.327764] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-03284b4d-8a46-40a3-903e-883ed29a58b0" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1412.327764] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-03284b4d-8a46-40a3-903e-883ed29a58b0" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1412.327874] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('03284b4d-8a46-40a3-903e-883ed29a58b0',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1412.351213] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1412.351481] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1412.351481] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1412.351647] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1412.351745] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1412.351871] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3bf31731-6b75-4dfa-b76c-ee83bdf17eaa is going to be updated. [ 1412.383545] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1412.383826] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1412.383826] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1412.384011] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1412.384197] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1412.393426] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3bf31731-6b75-4dfa-b76c-ee83bdf17eaa in Status: IN_PROGRESS for 2s [ 1412.829436] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 03284b4d-8a46-40a3-903e-883ed29a58b0 with status ACTIVE [ 1412.829714] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1412.829832] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1412.829832] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1412.830076] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1412.830167] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1412.830349] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1412.830448] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1412.830503] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1412.830661] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1412.830738] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1412.830915] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1412.831051] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1412.831087] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1412.831320] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1412.831320] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1412.831399] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 03284b4d-8a46-40a3-903e-883ed29a58b0 is going to be updated. [ 1412.832558] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-3bf31731-6b75-4dfa-b76c-ee83bdf17eaa taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1412.832652] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3bf31731-6b75-4dfa-b76c-ee83bdf17eaa" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1412.853384] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1412.853796] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1412.853796] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1412.853796] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1412.853925] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1412.854075] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-03284b4d-8a46-40a3-903e-883ed29a58b0" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1414.403389] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3bf31731-6b75-4dfa-b76c-ee83bdf17eaa in Status: SUCCESS [ 1414.403820] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3bf31731-6b75-4dfa-b76c-ee83bdf17eaa" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1414.403820] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3bf31731-6b75-4dfa-b76c-ee83bdf17eaa" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1414.403985] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3bf31731-6b75-4dfa-b76c-ee83bdf17eaa" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1414.404515] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1414.404515] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1414.404515] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1414.404515] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1414.404758] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1414.404758] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3bf31731-6b75-4dfa-b76c-ee83bdf17eaa',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1414.907564] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3bf31731-6b75-4dfa-b76c-ee83bdf17eaa',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1415.409930] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3bf31731-6b75-4dfa-b76c-ee83bdf17eaa',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1415.912419] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1415.912712] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1415.912712] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1415.912958] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1415.912958] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1415.913106] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3bf31731-6b75-4dfa-b76c-ee83bdf17eaa is going to be updated. [ 1415.941799] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1415.942034] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1415.942034] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1415.942236] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1415.942384] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1415.951294] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3bf31731-6b75-4dfa-b76c-ee83bdf17eaa in Status: IN_PROGRESS for 2s [ 1417.325691] env[65306]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1417.326087] env[65306]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 1417.963022] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3bf31731-6b75-4dfa-b76c-ee83bdf17eaa in Status: SUCCESS [ 1417.963260] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3bf31731-6b75-4dfa-b76c-ee83bdf17eaa" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1417.963419] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3bf31731-6b75-4dfa-b76c-ee83bdf17eaa" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1417.963649] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3bf31731-6b75-4dfa-b76c-ee83bdf17eaa" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1417.965097] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1417.965097] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1417.965097] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1417.965097] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1417.965097] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1417.965097] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3bf31731-6b75-4dfa-b76c-ee83bdf17eaa" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1417.965097] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3bf31731-6b75-4dfa-b76c-ee83bdf17eaa',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1418.467166] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3bf31731-6b75-4dfa-b76c-ee83bdf17eaa',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1418.969128] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3bf31731-6b75-4dfa-b76c-ee83bdf17eaa: rpc.has_security_group_logging(os_id): False [ 1418.987169] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1418.987425] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1418.987425] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1418.987626] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1419.011116] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1419.011527] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1419.011686] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1419.011771] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1419.012044] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1419.012163] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1419.012283] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3bf31731-6b75-4dfa-b76c-ee83bdf17eaa is going to be updated. [ 1419.073462] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1419.073665] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1419.073665] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1419.073795] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1419.073936] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1419.086469] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3bf31731-6b75-4dfa-b76c-ee83bdf17eaa in Status: IN_PROGRESS for 2s [ 1421.112205] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3bf31731-6b75-4dfa-b76c-ee83bdf17eaa in Status: SUCCESS [ 1421.112578] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3bf31731-6b75-4dfa-b76c-ee83bdf17eaa" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1422.327541] env[65306]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1422.327959] env[65306]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1427.329424] env[65306]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1427.329841] env[65306]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1432.331030] env[65306]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1432.331030] env[65306]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1437.331567] env[65306]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1437.331902] env[65306]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1442.332848] env[65306]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1442.333195] env[65306]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1447.334363] env[65306]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1447.334799] env[65306]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1452.335410] env[65306]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1452.335784] env[65306]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1457.336435] env[65306]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1457.336838] env[65306]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1462.338097] env[65306]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1462.338528] env[65306]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1467.339571] env[65306]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1467.339571] env[65306]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1472.340814] env[65306]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1472.340814] env[65306]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1477.341514] env[65306]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1477.341917] env[65306]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1479.995479] env[65306]: INFO networking_nsxv3.common.synchronization [req-0bf193a0-7042-470a-a8d3-a5648830d74c req-6a8d882d-1f2e-4512-8138-5021203534ae tempest-ServerActionsTestOtherA-65612913 tempest-ServerActionsTestOtherA-65612913-project-member] Enqueued Resource ID: 3bf31731-6b75-4dfa-b76c-ee83bdf17eaa with Priority: HIGHEST for action security_group_members [ 1479.996062] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3bf31731-6b75-4dfa-b76c-ee83bdf17eaa with Priority: HIGHEST for action security_group_members [ 1479.996822] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-3bf31731-6b75-4dfa-b76c-ee83bdf17eaa taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1479.996927] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3bf31731-6b75-4dfa-b76c-ee83bdf17eaa" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1479.996927] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3bf31731-6b75-4dfa-b76c-ee83bdf17eaa" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1479.997168] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3bf31731-6b75-4dfa-b76c-ee83bdf17eaa" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1479.997322] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1479.997424] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1479.997494] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1479.997668] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1479.997755] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1479.997843] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3bf31731-6b75-4dfa-b76c-ee83bdf17eaa',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1480.500533] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3bf31731-6b75-4dfa-b76c-ee83bdf17eaa',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1481.003128] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3bf31731-6b75-4dfa-b76c-ee83bdf17eaa',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1481.506572] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1481.506788] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1481.506844] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1481.507147] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1481.507273] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1481.507381] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3bf31731-6b75-4dfa-b76c-ee83bdf17eaa is going to be updated. [ 1481.549205] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1481.549426] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1481.549487] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1481.549696] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1481.549855] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1481.558761] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3bf31731-6b75-4dfa-b76c-ee83bdf17eaa in Status: IN_PROGRESS for 2s [ 1483.570074] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3bf31731-6b75-4dfa-b76c-ee83bdf17eaa in Status: SUCCESS [ 1483.570521] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3bf31731-6b75-4dfa-b76c-ee83bdf17eaa" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1484.997443] env[65306]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1484.997880] env[65306]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1489.998954] env[65306]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1489.998954] env[65306]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1495.000289] env[65306]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1495.000696] env[65306]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1495.124894] env[65306]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-fe90dfa9-7944-46fc-be94-0b3a151ba91d None None] NSXv3 Agent Agent loop - iteration:3 completed [ 1495.125248] env[65306]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-fe90dfa9-7944-46fc-be94-0b3a151ba91d None None] NSXv3 Agent Agent loop - iteration:4 started [ 1495.431147] env[65306]: INFO networking_nsxv3.common.synchronization [req-3bb85644-d19b-4bd5-aff6-a751606d2bb5 req-d4b8aadc-dd1e-4ba0-bd7f-7e55b4234a20 tempest-ServerActionsTestOtherA-65612913 tempest-ServerActionsTestOtherA-65612913-project-member] Enqueued Resource ID: 3bf31731-6b75-4dfa-b76c-ee83bdf17eaa with Priority: HIGHEST for action security_group_members [ 1495.431659] env[65306]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3bf31731-6b75-4dfa-b76c-ee83bdf17eaa with Priority: HIGHEST for action security_group_members [ 1495.431964] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock member-3bf31731-6b75-4dfa-b76c-ee83bdf17eaa taken with stack trace [, , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1495.432102] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3bf31731-6b75-4dfa-b76c-ee83bdf17eaa" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1495.432187] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3bf31731-6b75-4dfa-b76c-ee83bdf17eaa" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1495.432355] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3bf31731-6b75-4dfa-b76c-ee83bdf17eaa" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1495.432836] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1495.432947] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1495.433026] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1495.433182] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1495.433267] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1495.433361] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3bf31731-6b75-4dfa-b76c-ee83bdf17eaa',) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1495.935307] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1495.935549] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1495.935549] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1495.935749] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1495.935844] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1495.936050] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1495.936149] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1495.936206] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1495.936351] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1495.936427] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1495.936514] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3bf31731-6b75-4dfa-b76c-ee83bdf17eaa is going to be updated. [ 1495.966701] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1495.966981] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1495.966981] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1495.967132] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1495.967254] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1495.975166] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3bf31731-6b75-4dfa-b76c-ee83bdf17eaa in Status: IN_PROGRESS for 2s [ 1497.987055] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3bf31731-6b75-4dfa-b76c-ee83bdf17eaa in Status: SUCCESS [ 1497.987055] env[65306]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3bf31731-6b75-4dfa-b76c-ee83bdf17eaa deletion is rescheduled due to dependency. [ 1497.987497] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3bf31731-6b75-4dfa-b76c-ee83bdf17eaa" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1500.432584] env[65306]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1500.433013] env[65306]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1505.434176] env[65306]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1505.434563] env[65306]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1510.435959] env[65306]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1510.436397] env[65306]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1515.438016] env[65306]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1515.438016] env[65306]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1520.076397] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1520.076933] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1520.076933] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1520.076933] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1520.077076] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1520.439282] env[65306]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1520.439282] env[65306]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1520.580030] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1521.081990] env[65306]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=65306) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1521.584665] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 1521.584858] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 1522.336123] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1522.336543] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1522.336543] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1522.336627] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1522.348584] env[65306]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 1522.349558] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1522.350782] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 1522.394552] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1522.394754] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1522.394754] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1522.394981] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1522.406597] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1522.407365] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 1522.407447] env[65306]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=65306) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1522.407538] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 1522.441766] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1522.441957] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1522.441957] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1522.442203] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1522.443072] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1522.443239] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 1522.531638] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1522.531884] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1522.531884] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1522.532052] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1522.532367] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1522.532614] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 1522.615154] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1522.615391] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1522.615391] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1522.615577] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1522.615877] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1522.616262] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:33. [ 1522.616358] env[65306]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'b8dc2b13-0f06-4660-ab7d-a65578892823', '60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d', '24148ee6-c16b-47cd-97f7-9716f2d1e6b4', 'e84d3263-5312-46e3-9331-fbbe9b6a7e85', '17a26b80-c2ff-49b2-a30b-bd2b600f8787', '52d329d0-14c2-4610-ad32-9ade5237bab0', '7f22d913-90d3-4ccb-8780-b9dbc479a7d3', '56904b3c-38e4-4547-9a1d-cc787c3fef9d', '77ce039f-cf05-4e5a-9730-79ab5552fd3f', 'dbcb04c7-d4cb-4ab9-8312-c80dffeeaa42', 'a70508b0-bb5b-4d0d-af41-b80fbdcfe90e', '3bf31731-6b75-4dfa-b76c-ee83bdf17eaa', '830915ca-b7ed-480d-8dcc-06210706a96a', '55a6ae08-0730-4d04-bc2c-3f0c36758315', 'd82bad56-9830-4c7d-9763-6d8a05e0998c', 'c3ffb1bc-84c3-4121-a677-8d413e70c9cc', '7b301620-e19b-4a95-9103-ce7982b7fa1d', 'a7dafaf4-f702-4dc9-bc77-265f5268966a', '23ae6942-da1d-46a7-951e-aa32b51f50d2', '2536346e-d62c-4c9f-a652-a4136cc7ff65', '5188a191-fc4a-4216-b94f-2b854c8abd88', '30524546-2ed3-474c-bf2b-fc6aff50dfec', '5ec09b70-aa5a-48ff-b72f-a5c6c81190e0', '4ccf00ad-53bf-45d0-a342-260b14c2ccf2', '5c095c1f-60f5-47d0-b270-e33f847ba33b', 'f5174f7c-dc12-4dad-9284-eed34d64b830', 'e3e0f6b2-2984-4938-adcc-0374a714ff76', 'c3a4b03d-2231-4b42-a522-be404c2784e5', '4603b17e-9032-4f9f-a8ac-9d7d5e34db46', '4e234e08-a192-4c7a-badf-3e57629854d7', '2cdaf88a-80a7-4019-9156-d7e0483af77f', 'a3364d7c-b2fd-4f01-932a-1feef0fa76de', '6e403189-fcac-40e3-aa50-4c17f4d29895'} {{(pid=65306) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1522.616484] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 1522.635019] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1522.635199] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1522.635243] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1522.635431] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1522.635512] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1522.635625] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 1522.635693] env[65306]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=65306) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1522.635777] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 1522.722524] env[65306]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65306) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1522.722735] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1522.722735] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1522.722934] env[65306]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1522.724082] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1522.724350] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 1522.724431] env[65306]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=65306) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1522.724497] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 1522.724558] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 1522.724644] env[65306]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 20/33 resources of Type:Security Group Rules [ 1522.724720] env[65306]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: b8dc2b13-0f06-4660-ab7d-a65578892823 with Priority: HIGH for action security_group_rules [ 1522.724888] env[65306]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 60a7017a-5ed5-4c49-a49c-9e32f2ff7a6d with Priority: HIGH for action security_group_rules [ 1522.724888] env[65306]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 24148ee6-c16b-47cd-97f7-9716f2d1e6b4 with Priority: HIGH for action security_group_rules [ 1522.725072] env[65306]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: e84d3263-5312-46e3-9331-fbbe9b6a7e85 with Priority: HIGH for action security_group_rules [ 1522.725072] env[65306]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 17a26b80-c2ff-49b2-a30b-bd2b600f8787 with Priority: HIGH for action security_group_rules [ 1522.725072] env[65306]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 52d329d0-14c2-4610-ad32-9ade5237bab0 with Priority: HIGH for action security_group_rules [ 1522.725167] env[65306]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 7f22d913-90d3-4ccb-8780-b9dbc479a7d3 with Priority: HIGH for action security_group_rules [ 1522.725207] env[65306]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 56904b3c-38e4-4547-9a1d-cc787c3fef9d with Priority: HIGH for action security_group_rules [ 1522.725238] env[65306]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 77ce039f-cf05-4e5a-9730-79ab5552fd3f with Priority: HIGH for action security_group_rules [ 1522.725299] env[65306]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: dbcb04c7-d4cb-4ab9-8312-c80dffeeaa42 with Priority: HIGH for action security_group_rules [ 1522.725361] env[65306]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: a70508b0-bb5b-4d0d-af41-b80fbdcfe90e with Priority: HIGH for action security_group_rules [ 1522.725419] env[65306]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 3bf31731-6b75-4dfa-b76c-ee83bdf17eaa with Priority: HIGH for action security_group_rules [ 1522.725473] env[65306]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 830915ca-b7ed-480d-8dcc-06210706a96a with Priority: HIGH for action security_group_rules [ 1522.725531] env[65306]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 55a6ae08-0730-4d04-bc2c-3f0c36758315 with Priority: HIGH for action security_group_rules [ 1522.725581] env[65306]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: d82bad56-9830-4c7d-9763-6d8a05e0998c with Priority: HIGH for action security_group_rules [ 1522.725638] env[65306]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: c3ffb1bc-84c3-4121-a677-8d413e70c9cc with Priority: HIGH for action security_group_rules [ 1522.725700] env[65306]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 7b301620-e19b-4a95-9103-ce7982b7fa1d with Priority: HIGH for action security_group_rules [ 1522.725753] env[65306]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: a7dafaf4-f702-4dc9-bc77-265f5268966a with Priority: HIGH for action security_group_rules [ 1522.725817] env[65306]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 23ae6942-da1d-46a7-951e-aa32b51f50d2 with Priority: HIGH for action security_group_rules [ 1522.725877] env[65306]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 2536346e-d62c-4c9f-a652-a4136cc7ff65 with Priority: HIGH for action security_group_rules [ 1522.725988] env[65306]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=65306) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}}